On-Site
Full-Time
Pune, Maharashtra
India
About the Role
Are you looking for value-adding and impactful work?
Do you want to make a difference with your expertise?
With us, you’ll be able to make it happen.
NCS is a leading technology services firm, operating across Asia Pacific in over 20 countries, providing services and solutions in consulting, digital services, technology, and more.
We believe in utilizing the power of technology to make extraordinary things happen and to create lasting impact and value for our people, communities, and partners. Our diverse 12,000-strong workforce has delivered a wealth of large-scale, mission-critical, and multi-platform projects for governments and enterprises in Singapore and the APAC region.
What we do
We drive our passion for harnessing technology.
We bring people and technology together.
We advance communities and transform industries.
We’re searching for a Senior Data Engineer, to be part of our diverse team of talent here at NCS!
If you believe in going above and beyond, want to exemplify the best, and wish to bring people and technology together like never before, then we would love to have a conversation with you!
A little about you:
An experienced and knowledgeable leader and manager with experience in a Data Engineering.
Technical Requirement :
Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks
Ensure data pipelines run smoothly and efficiently
Developing scalable and re-usable frameworks for ingesting of data sets
Integrating the end to end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Working with event based / streaming technologies to ingest and process data
Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
Evaluating the performance and applicability of multiple tools against customer requirements
Technically competent in Cloud and Databricks to provide technical advice to the team and to be involved in issue resolution
Provide on-call support and afterhours/weekend support as needed
Fulfill Service Requests related to Data Analytics platform
Lead and drive optimization and continuous improvement initiatives
Experience and Skills required:
• Minimum 8 years of experience in data analytics field
• Experience with Azure/AWS Databricks
• Experience in building and optimizing data pipelines, architectures and data sets
• Excellent experience in Scala or Python, PySpark and SQL
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques
• Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS
• Hands on experience in performance tuning and optimizing code running in Databricks environment
• Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment
We want to create the extraordinary and to impact millions of people every day.
We believe in building a talent-led delivery model to enable our best people to lead, and to support them with the right structure, processes, and tools to ensure that our clients are delivered top-quality services.
We want to invest in you!
Great work is never done alone, and that’s why we also believe in creating a collaborative work environment to bring people with different expertise and talent together.
We create opportunities for our people to grow in our organization with well-defined career tracks and specializations to ensure that our people and talent can continuously deliver new value for our clients.
We’re here to make the extraordinary happen.
Learn more at ncs.co and our LinkedIn Career site.
All profiles are handled with the highest level of confidentiality.
Do you want to make a difference with your expertise?
With us, you’ll be able to make it happen.
NCS is a leading technology services firm, operating across Asia Pacific in over 20 countries, providing services and solutions in consulting, digital services, technology, and more.
We believe in utilizing the power of technology to make extraordinary things happen and to create lasting impact and value for our people, communities, and partners. Our diverse 12,000-strong workforce has delivered a wealth of large-scale, mission-critical, and multi-platform projects for governments and enterprises in Singapore and the APAC region.
What we do
We drive our passion for harnessing technology.
We bring people and technology together.
We advance communities and transform industries.
We’re searching for a Senior Data Engineer, to be part of our diverse team of talent here at NCS!
If you believe in going above and beyond, want to exemplify the best, and wish to bring people and technology together like never before, then we would love to have a conversation with you!
A little about you:
An experienced and knowledgeable leader and manager with experience in a Data Engineering.
Technical Requirement :
Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks
Ensure data pipelines run smoothly and efficiently
Developing scalable and re-usable frameworks for ingesting of data sets
Integrating the end to end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Working with event based / streaming technologies to ingest and process data
Working with other members of the project team to support delivery of additional project components (API interfaces, Search)
Evaluating the performance and applicability of multiple tools against customer requirements
Technically competent in Cloud and Databricks to provide technical advice to the team and to be involved in issue resolution
Provide on-call support and afterhours/weekend support as needed
Fulfill Service Requests related to Data Analytics platform
Lead and drive optimization and continuous improvement initiatives
Experience and Skills required:
• Minimum 8 years of experience in data analytics field
• Experience with Azure/AWS Databricks
• Experience in building and optimizing data pipelines, architectures and data sets
• Excellent experience in Scala or Python, PySpark and SQL
• Ability to troubleshoot and optimize complex queries on the Spark platform
• Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques
• Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS
• Hands on experience in performance tuning and optimizing code running in Databricks environment
• Demonstrated analytical and problem-solving skills particularly those that apply to a big data environment
We want to create the extraordinary and to impact millions of people every day.
We believe in building a talent-led delivery model to enable our best people to lead, and to support them with the right structure, processes, and tools to ensure that our clients are delivered top-quality services.
We want to invest in you!
Great work is never done alone, and that’s why we also believe in creating a collaborative work environment to bring people with different expertise and talent together.
We create opportunities for our people to grow in our organization with well-defined career tracks and specializations to ensure that our people and talent can continuously deliver new value for our clients.
We’re here to make the extraordinary happen.
Learn more at ncs.co and our LinkedIn Career site.
All profiles are handled with the highest level of confidentiality.