Job Title: Azure Data Engineer

Department: Data Platform & Operations

Location: Abu Dhabi

Summary: We are seeking a Data Engineer with deep expertise in ETL/ELT, PySpark, Data bricks, Azure ecosystem, and experience with Enterprise Systems like Oracle ERP, ERP Fusion, and Salesforce.  The successful candidate will play a key role in designing and implementing complex data pipelines, handling both structured and unstructured datasets, and optimizing our Azure-based data systems. The successful candidate will have a strong foundation in data warehousing concepts and database design. Additionally, this individual will work closely with other data engineers & the data science team to support their analytics needs and improve the performance of our data products.

Key Responsibilities:

• Design, construct, install, test, and maintain highly scalable and robust data management systems.

• Understand and apply data warehousing concepts to design and implement robust data warehouse tables in line with business requirements.

• Build complex ETL/ELT processes for large-scale data migration and transformation across platforms and Enterprise systems such as: Oracle ERP, ERP Fusion, and Salesforce.

• Ability & expertise to extract data from several sources like APIs, Jsons, Databases etc.

• Leverage PySpark and Data bricks within the Azure ecosystem to manipulate large datasets, improve the performance, and enhance scalability of our data operations.

• Develop and implement Azure-based data architectures consistent across multiple projects while adhering to best practices and standards.

• Lead initiatives for data integrity and normalization within Azure data storage and processing environments.

• Evaluate and optimize Azure-based database systems for performance efficiency, reusability, reliability, and scalability.

• Troubleshoot complex data-related issues within Azure and provide expert guidance and support to the team.

• Ensure all data processes adhere to governance, data security, and privacy regulations.

Required Qualifications:

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

• 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer.

• Expertise in Python, SQL, and deep understanding of PySpark.

• Proficient in Data bricks or similar big data solutions.

• Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.

• Proven experience in designing and deploying high-performance data processing systems on.

• Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure SQL Data Warehouse, Azure Data bricks.

• Ability to design and implement data schemas, data models, and database designs in accordance with business requirements.

Preferred Qualifications:

• Data bricks certification or equivalent big data technology certification.

• Exceptional analytical and problem-solving abilities.

• Excellent communication skills.

Skills

Required Qualifications:

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.

• 8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer.

• Expertise in Python, SQL, and deep understanding of PySpark.

• Proficient in Databricks or similar big data solutions.

• Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.

• Proven experience in designing and deploying high-performance data processing systems on.

• Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks.

• Ability to design and implement data schemas, data models, and database designs in accordance with business requirements.

Job Details

Posted Date: 2024-04-18

Job Location: United Arab Emirates - Abu Dhabi

Job Role: Information Technology

Company Industry: IT Services

Monthly Salary: US $4,000