Hybrid
Full-Time
Bengaluru, Karnataka
India
About the Role
Experience:8+Years
Location: Offshore (prefer Bangalore/Pune)
Job Summary
We are looking for a highly skilled Cloud Engineer with a strong background in real-time and batch data ingestion and data processing, azure products-devops, azure cloud. The ideal candidate should have a deep understanding of streaming architectures and performance optimization techniques in cloud environments, preferably in subsurface domain.
Key Responsibilities
Automation experience essential: Scripting, using PowerShell.
ARM Templates, using JSON (PowerShell also acceptable)
Azure DevOps with CI/CD, Site Reliability Engineering
Must be able to understand the concept of how the applications function.
The ability to priorities workload and operate across several initiatives simultaneously
Update and maintain the Kappa-Automate database and connectivity with the pi historian and data lake
Participate in troubleshooting, performance tuning, and continuous improvement of the Kappa Automate platform
Designing and implementing highly configurable Deployment pipelines in Azure
Configuring Delta Lake on Azure Databricks
Apply performance tuning techniques such as partitioning, caching, and cluster
Working on various Azure storage types
Work with large volumes of structured and unstructured data, ensuring high availability and performance.
Collaborate with cross-functional teams (data scientists, analysts, business users)
Qualifications
• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 8+ years of experience in data engineering or a related role.
• Proven experience with Azure technologies.
Location: Offshore (prefer Bangalore/Pune)
Job Summary
We are looking for a highly skilled Cloud Engineer with a strong background in real-time and batch data ingestion and data processing, azure products-devops, azure cloud. The ideal candidate should have a deep understanding of streaming architectures and performance optimization techniques in cloud environments, preferably in subsurface domain.
Key Responsibilities
Automation experience essential: Scripting, using PowerShell.
ARM Templates, using JSON (PowerShell also acceptable)
Azure DevOps with CI/CD, Site Reliability Engineering
Must be able to understand the concept of how the applications function.
The ability to priorities workload and operate across several initiatives simultaneously
Update and maintain the Kappa-Automate database and connectivity with the pi historian and data lake
Participate in troubleshooting, performance tuning, and continuous improvement of the Kappa Automate platform
Designing and implementing highly configurable Deployment pipelines in Azure
Configuring Delta Lake on Azure Databricks
Apply performance tuning techniques such as partitioning, caching, and cluster
Working on various Azure storage types
Work with large volumes of structured and unstructured data, ensuring high availability and performance.
Collaborate with cross-functional teams (data scientists, analysts, business users)
Qualifications
• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• 8+ years of experience in data engineering or a related role.
• Proven experience with Azure technologies.