Azure Data Engineer

Job Overview:

We are seeking a skilled Azure Data Engineer to join our team, who will be pivotal in managing and analyzing large sets of data to drive business insights and decisions. The ideal candidate will have extensive experience working with Azure Synapse, Azure Data Factory, Databricks, Azure Function, Cosmos DB, Azure DevOps, Python, SQL, and a solid understanding of Medallion Architecture, Delta lake and data Lakehouse concepts.

Key Responsibilities:

* Design, implement, and manage end-to-end data solutions using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure Function, Cosmos DB and Databricks.

* Develop and maintain efficient data pipelines and workflows to process data at scale.

* Build and maintain notebooks in Databricks for data processing and analytics.

* Collaborate with various teams to turn business needs into technical solutions.

* Design and implement solutions on Medallion Architecture, Delta lake and data Lakehouse frameworks.

* Maintain JSON files for configuration and data exchange purposes.

* Utilize and maintain Azure DevOps pipelines for continuous integration and deployment of data solutions.

* Implement and enforce best practices for data governance, security, and compliance on Azure resources and SQL Database security principles.

* Review current data solutions and identify opportunities for improvements and optimizations.

Required Skills/Qualifications:

  • Extensive experience with Azure Synapse Analytics, Azure Data Factory, Key Vault and Databricks,

  • Strong in Python and SQL for data processing and querying.

  • Strong understanding of Medallion Architecture and data Lakehouse principles.

  • Experience with Azure DevOps pipelines for CI/CD and version control.

  • Experience in building and maintaining Function Apps using Azure Functions.

  • Experience with Azure Cosmos DB for handling globally distributed, multi-model databases.

  • Proficiency in maintaining JSON files.

  • In-depth knowledge of security principles for Azure resources and SQL databases.

  • Excellent problem-solving skills and attention to detail.

  • Ability to work collaboratively in a diverse team and manage multiple priorities.

  • Prior experience in a similar role within a fast-paced, dynamic environment.

  • Certification in Azure Data Engineering or related disciplines would be a plus.

  • Open for Project based

  • Hybrid

Please send your most updated resume to info@247international.net.