Platform Engineer

Key Responsibilities:

• Manage and maintain cloud infrastructure on AWS, ensuring high availability,
performance, and cost-efficiency
• Administer and monitor Databricks environment including cluster management,
user access, job scheduling, and performance optimization
• Collaborate with data engineering and DevOps teams to support CI/CD
pipelines, automation, and infrastructure as code
• Implement and manage platform-level security, compliance, and governance
best practices
• Troubleshoot platform issues, perform root cause analysis, and implement
preventative measures
• Create and maintain documentation for platform configurations, processes, and
best practices
• Support onboarding of new users, access management, and training on platform
usage
• Monitor resource usage and optimize performance and cost through rightsizing
and usage policies

Required Skills:

• Strong hands-on experience with AWS services (EC2, S3, IAM, CloudWatch,
VPC, etc.)
• Proven experience in Databricks administration, including workspace setup,
cluster configuration, user/group roles, and notebook management
• Experience with scripting languages (Python, Bash, etc.) for automation
• Familiarity with Terraform, CloudFormation, or similar IaC tools
• Good understanding of networking, security, and DevOps practices
• Strong problem-solving skills and ability to work independently
• Excellent communication and documentation skills

Good to Have:

• AWS certification (Solutions Architect / SysOps Admin)
• Experience with other data platforms (Snowflake, Azure Data Factory, etc.)
• Knowledge of monitoring and alerting tools (Datadog, Prometheus, etc.