Informatica BDM - Data Engineer

Our client is a leading firm in the technology sector, dedicated to leveraging cutting-edge technology to drive business success. They are seeking a highly skilled Informatica BDM Developer to join their dynamic team and contribute to our mission of innovation and excellence.

In this role, you will be responsible for:

• Develop and implement Informatica BDM mappings for data extraction from multiple sources to Data Lake.

• Create customized BDM mappings/workflows for incremental data loading using Informatica Developer.

• Deploy mappings as part of an application on Data Integration service for native execution or push down using Hive/Blaze/Spark engines.

• Design and develop BDM mappings in Hive/Spark/Blaze mode for handling large volumes of INSERT/UPDATE operations.

• Develop and implement complex quality rules with cleansing, parsing, standardization, validation, etc.

• Collaborate with cross-functional teams, influencing technical considerations and enhancing team productivity and effectiveness.

• Utilize tools such as Sqoop, Flume, and Kafka for data management.

• Perform performance tuning in SQL and Informatica to optimize ETL processes.

• Design and implement complex ETL Mappings using transformations such as Source Qualifier, Sorter, Aggregator, Expression, Joiner, Dynamic Lookup, Connected and Unconnected Lookups, Filters, Sequence, Router, and Update Strategy.

Requirements

The ideal candidate will have a strong background in ETL processes, SQL, Hadoop, Spark, and Hive, and will be responsible for implementing and optimizing BDM mappings to extract data from various sources into our Data Lake. Furthermore, the candidate should be the following criteria:

• Degree or postgraduate qualification in Computer Science or related field (or equivalent industry experience).

• Minimum [specify number of years] years of development and design experience in Informatica Power Center/Power Exchange & Big Data Management (BDM).

• Extensive experience with ETL Informatica, SQL, Scoop, Hadoop, Spark, and Hive.

• Self-motivated and able to drive projects with minimal supervision.

• Excellent interpersonal skills, with the ability to interact, present ideas, and influence teams effectively.

• Enthusiastic and passionate about technology, fostering a motivating environment for the team.

• Proficiency in implementing Informatica BDM mappings for data extraction.

• Expertise in creating and deploying BDM mappings/workflows using Informatica Developer.

• Strong knowledge of Hive/Spark/Blaze execution engines.

• Ability to design and develop ETL processes for large-scale data operations.

• Experience with data management tools like Sqoop, Flume, and Kafka.

• Advanced skills in performance tuning for SQL and Informatica.

• Excellent soft skills for team interaction and stakeholder communication.

• Positive attitude, effective team relations, and a climate of trust within the team.