Job Description

Job Title: Data Engineer/Azure
Job Number: 201316
Duration of Contract: 6 Months with potential for longer term 
extension
 
This is an exciting opportunity to work for company that truly makes a difference in lives of their clients/customers. By delivering evidence based analytics that focus on the real needs of those they serve.

Our client has an immediate need for Data Engineer to join their team. The successful candidate will have excellent analytical  and communication skills.  Must be able to confidently present ideas to colleagues and entire business community.

Opportunity Overview :
  • Responsible for design, develop, test, and implement data pipeline
  • Develop reusable/scalable code and pipelines process for data collection, ingestion, extraction, transformation, and operation using Microsoft Azure based tools and services
  • Build unit and full testing mechanisms to assure quality of code to be implemented in pipelines
  • Maintain and refactor existing code to maximize data usability and consistency across different business functions
  • Implement and support platforms that can work with large datasets and unstructured data
  • Leverage Azure Data Lake/Delta Lake and/or blob storage to prepare large unstructured datasets
  • Leverage native Azure tools such as Synapse, Lake Storage, PySpark Notebook, Databricks, and Azure Data Factory to build ETL/ELT jobs from Synapse in order to automate data flows
  • Work with members of the Data Engineering, DevOps and other teams in order to understand gaps in automation and fill as needed
  • Develop and design solutions by studying information needs; conferring with users; studying flow, data usage, and work processes; investigating problem areas; and following the Agile development lifecycle
  • Builds relationship with internal teams to provide data and services
  • Integrate NLP and other data together using automated pipeline
  • Redesign current flows to increase throughput and streamline data for downstream consumers
Qualifications & Required skills:
4+ years’ experience with the following:
  • Using SQL and/or NOSQL databases 
  • Cloud environment with Azure strongly preferred, will consider experience AWS,  GCS or Private Cloud as well
  • Python or .NET and Spark development
  • Big Data Platforms (Data Lakes, Data Lakes Analytics, Azure Machine Learning, Snowflake, CosmosDB, Synapse, Databricks, Spark/PySpark, Kafka, Hadoop, and Cloudera)
3+ years’ of experience with the following:
  • Microsoft tools such as Windows servers, SQL server, .NET framework and .NET core.
  • Analysis Services (SSAS), Reporting Services (SSRS), Integration Services (SSIS).
  • Custom ETL design, implementation/maintenance, data warehouse, schema design, and data modeling.
  • Automation using cloud based tools and services.


Educational Requirements:
Bachelor’s degree in Computer Science or relevant experience required. 

Work location and Additional Info:

Overture Partners is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, national origin, disability, sexual orientation, gender identity or expression, marital status, genetic information, protected veteran status, or other factors protected by federal, state, and/or local law.

Application Instructions

Please click on the link below to apply for this position. A new window will open and direct you to apply at our corporate careers page. We look forward to hearing from you!

Apply Online