BUSINESS INTELLIGENCE & ANALYTICS DATA ENGINEER

The Data Engineer’s role is to develop, maintain, and ensure efficient, scalable data solutions on client’s Data Lake, DevOps, and Databricks Unity Catalog. This role will oversee proper design implementation and code standards for relevant data and analytics projects. Moreover, they will be responsible for analyzing, organizing, and combining data from different sources building optimal data systems and pipelines ensuring that business needs and objectives are delivered. They will also coordinate the solution delivery by reviewing and supervising development efforts, project plans, and assignments.

As the Data Engineer in Technology – Business Intelligence & Analytics, you will:

  • Implement modern data solutions with Azure Data Factory, Data Lake, and Databricks.

  • Analyze the impact of new and evolving business requirements and explore the feasibility of how to accommodate them.

  • Work with Data & Analytics functions together with external development teams to ensure that the configuration and customization meet business requirements and performance baseline.

  • Follow up with external developers on problems & incidents related to Central Data Lake platform processes and failures, ensure that the cause is identified and fixed.

  • Perform SIT/UAT and performance & regression testing of new and existing developments to ensure accurate and efficient operation using standard processes.

  • Support production systems including issue resolution.

  • Develop enhancements, and changes based on functional or technical specifications.

  • Monitor system and project pipeline performance.

  • Conduct regular design and code reviews to make sure that the Data Architect’s vision is implemented accurately.

  • Help implement Databricks Unity Catalog across the enterprise.

Requirements:

  • University Degree in Computer or Technical Science or strong IT background, plus additional business education

  • 1+ year(s) of experience in Data and Analytics from modeling and reporting standpoint.

  • 1+ year(s) of experience in Databricks.

  • 3+ exposure to IT architecture and solutions for data flows among systems and applications.

  • 3+ years delivering solutions on the Microsoft Azure (or similar CSPs) platform with a special emphasis on data solutions and services.

  • An expert in DevOps CI/CD.

Additional Skills:

  • Azure Data Lake experience plus Databricks and Data Factory

  • Very good understanding of Azure PaaS management and resource monitoring

  • Very good Database skills (Azure SQL and Synapse), scripting, and data modeling.

  • Experience on Azure or any similar cloud platform such as Amazon/Google Cloud is a must.

  • Experience on Azure DevOps or similar version control tools (git).

  • Having an experience in Python and PySpark/Spark is a plus.

  • Familiar with OLTP vs. OLAP (star schema, snowflake schema, experience with data warehousing).

Please send your most updated resume to info@247international.net.