Azure Data Engineer
: Job Details :

• Design, construct, test and maintain data architectures and data pipelines;
• Ensure our data architecture supports the requirements of the business;
• Develop custom data models and algorithms to apply to data sets;
• Assess the effectiveness and accuracy of new data sources and data gathering techniques. Discover opportunities for data acquisition;
• Develop data set processes for data modeling, mining and production;
• Employ a variety of languages and tools to marry systems together;
• Recommend ways to improve data reliability, efficiency and quality;
• Leverage large volumes of data from internal and external sources to answer business demands;
• Introduce automation through effective metadata management and using innovative and modern tools and techniques. Partially or completely automate the most common and repeatable data preparation and integration tasks;
• Propose appropriate data ingestion, preparation, integration and operationalization techniques in addressing data requirements;
• Lead the development of data governance policies and best practices for consumers and users of data we provision;
• Coordinate with different functional teams to implement models and monitor outcomes; and
• Develop processes and tools to monitor and analyze model performance and data accuracy.

Proficiencies:

• Designing, building, and managing data pipelines for diverse data structures.
• Utilizing advanced analytics tools, including C#, Python, and others.
• Proficiency in SQL, PL/SQL, SSIS, and SSAS.
• Familiarity with emerging NoSQL/Hadoop-oriented databases like MongoDB, Cassandra, etc.
• Working with large, heterogeneous datasets to optimize data pipelines and architectures.
• Utilizing popular data discovery, analytics, and BI software such as Tableau, Power BI, etc.
• Collaborating with data governance, data quality, and data security teams.
• Implementing Microsoft MDM (Master Data Management) and MDS.
• Troubleshooting complex issues across multiple systems and driving solutions.
• Effectively communicating technical concepts to non-technical stakeholders.
• Maintaining a high level of data security awareness.
• Bonus: Experience with financial and legal industry data.

Qualifications:

• Bachelor's or Master's degree in computer science, statistics, applied mathematics, data management, information systems, information science, or related quantitative field, or equivalent work experience.
• Minimum of five years' experience in data management disciplines, including integration, modeling, optimization, and data quality.
• Minimum of three years' experience collaborating in cross-functional teams and engaging with business stakeholders.
• Strong communication, collaboration, problem-solving, and analytical skills.
• Proven ability to excel in a collaborative environment and independently resolve issues while efficiently self-directing work activities.