Senior Data Engineer

Job Description: Senior Data Engineer
Location: Bangalore/Pune
Work Mode: Hybrid

Senior Data Engineer
As a Senior Data Engineer at Capco you will/have:
Work alongside clients to interpret requirements and define industry-leading solutions
Design and develop robust, well tested data pipelines
Demonstrate and help clients adhere to best practices in engineering and SDLC
Excellent knowledge of building event-driven, loosely coupled distributed applications
Experience in developing both on-premise and cloud-based solutions
Build and improve strong relationships with peers, senior stakeholders and client
Leading and mentoring the team of junior and mid-level engineers
Contribute to security designs and have advanced knowledge of key security technologies e.g. TLS, OAuth, Encryption
Support internal Capco capabilities by sharing insight, experience and credentials


Skills & Expertise:
You will have experience working with some of the following Methodologies/Technologies.
Strong cloud provider’s experience on GCP
Hands on experience using Python. Scala and Java are also nice to have but not fully required.
Experience in most or all of data and cloud technologies such as Hadoop, HIVE, Spark, Flume, PySpark, DataProc, Cloudera, Airflow, Oozie, S3, Terraform etc.
Hands on experience with schema design using semi-structured and structured data structures
Experience using messaging technologies – Kafka, Kafka Connect, Spark Streaming, Amazon Kinesis
Strong experience in SQL
Good understanding of the differences and tradeoff between SQL and NoSQL, ETL and ELT
Understanding of containerization (Docker, Kubernetes) and orchestration techniques
Experience with data lake formation and data warehousing principles and technologies – BigQuery, Redshift, Snowflake
Experience using version control tool such as Git.
Familiar with development good practices and optimization techniques.
Experience in design, build and maintain CI/CD Pipelines on Jenkins, CircleCI
Enthusiasm and ability to pick up new technologies as needed to solve your problems

Why Join Capco as a Data Engineer?
You will work on engaging projects with some of the largest banks in the world, on projects that will transform the financial services industry.
You’ll be part of digital engineering team that develop new and enhance existing financial and data solutions, having the opportunity to work on exciting greenfield projects as well as on established Tier1 bank applications adopted by millions of users.
You’ll be involved in digital and data transformation processes through a continuous delivery model.
You will work on automating and optimizing data engineering processes, develop robust and fault tolerant data solutions and enhancing security standards both on cloud and on-premise deployments.
You’ll be able to work across different data, cloud and messaging technology stacks.
You’ll have an opportunity to learn and work with specialized data and cloud technologies to widen the skill set.