Job Description
Role Overview An Azure Cosmos DB Engineer to design, build and optimise cloud-native applications and data pipelines. The role focuses on Cosmos DB (SQL and Mongo APIs), PySpark on Microsoft Fabric, and CI/CD through GitLab. The successful candidate will work closely with solution architects and DevOps teams to integrate Cosmos DB into microservices, while meeting security, governance and data protection standards. Key Responsibilities Develop cloud-native applications using Azure Cosmos DB (SQL API and Mongo API). Design NoSQL data models, indexing strategies and partitioning schemes for the best performance, and tune queries to cut RU consumption and improve response times. Design and implement PySpark data pipelines on Microsoft Fabric. Build and maintain CI/CD pipelines through GitLab DevOps, with automated unit and integration testing in Pytest. Work with solution architects and DevOps teams to integrate Cosmos DB into microservices, and ensure compliance with security, governance and data protection standards. Top 5 Skills Azure Cosmos DB: Proven hands-on experience, including query optimisation, throughput management, and a strong understanding of partitioning, indexing and consistency levels, plus the SQL API. Change Data Feed and Spark: Strong knowledge of the Cosmos DB Change Data Feed, including integrating and debugging Spark with it. PySpark: High proficiency in PySpark and Spark distributed computing concepts. SDKs and application design: High proficiency ..... full job details .....