Hybrid
Full-Time
Chennai, Tamil Nadu
India
Skills
Microsoft Azure
Machine Tools
Data Engineering
Azure Databricks
Keras
About the Role
Job Title-Azure Data Engineer
Work location: Oragadam chennai
Job Requirements
Experience
3 years of experience in data engineering, focusing on big data technologies and Azure cloud platforms.
3 years of experience developing data integrations using in Azure Databricks, PySpark, Spark Pools, and large-scale data processing.
Technical Skills
Proficient in Python (specifically PySpark) and data analysis libraries like Pandas, NumPy, and SciPy.
Experience with Spark SQL, DataFrames, and RDDs for data processing and transformation.
Hands-on experience with Azure Data Lake, Azure Blob Storage, and Azure Synapse Analytics.
Familiarity with Databricks Notebooks, Delta Lake, and MLflow for model tracking and management.
Expertise in creating, optimizing, and managing Spark Pools for distributed computing.
Work location: Oragadam chennai
Job Requirements
Experience
3 years of experience in data engineering, focusing on big data technologies and Azure cloud platforms.
3 years of experience developing data integrations using in Azure Databricks, PySpark, Spark Pools, and large-scale data processing.
Technical Skills
Proficient in Python (specifically PySpark) and data analysis libraries like Pandas, NumPy, and SciPy.
Experience with Spark SQL, DataFrames, and RDDs for data processing and transformation.
Hands-on experience with Azure Data Lake, Azure Blob Storage, and Azure Synapse Analytics.
Familiarity with Databricks Notebooks, Delta Lake, and MLflow for model tracking and management.
Expertise in creating, optimizing, and managing Spark Pools for distributed computing.