Azure Data Engineer Job at Programmers.io, Dallas, TX

eC84TkYrVjRucEowZzd6WDdrSjNjYk05UlE9PQ==
  • Programmers.io
  • Dallas, TX

Job Description

Job Description:

Role Overview

We are looking for a Data Engineer with strong experience in Azure and Apache Spark to design and build scalable, high-performance data solutions. The ideal candidate will work on modern cloud data platforms, ensuring reliable data pipelines and supporting analytics and business intelligence needs. Familiarity with Databricks and Collibra will be an added advantage.

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure services

Build and optimize Spark-based data processing applications

Implement ETL/ELT workflows for batch and real-time data processing

Work with Azure Data Factory (ADF) or similar tools for orchestration

Store and manage data in Azure Data Lake (ADLS) or cloud storage systems

Perform data transformation, cleansing, and validation

Ensure data quality, governance, and security compliance

Collaborate with analysts, data scientists, and business stakeholders

Monitor, debug, and optimize data workflows

Required Skills & Qualifications

Technical Skills

Strong hands-on experience with Microsoft Azure (ADF, ADLS, Synapse or similar)

Solid experience in Apache Spark (PySpark preferred)

Proficiency in Python and SQL

Experience in designing data pipelines and data models

Good understanding of data warehousing concepts

Experience with version control and CI/CD pipelines (e.g., Azure DevOps)

Nice-to-Have Skills

Experience with Azure Databricks for distributed data processing

Exposure to Collibra or similar data governance/catalog tools

Knowledge of Delta Lake architecture

Familiarity with streaming technologies (Kafka, Event Hub)

Experience with BI tools such as Power BI

Job Tags

Similar Jobs

Atrium Hospitality

Housekeeping Laundry Attendant Job at Atrium Hospitality

 ..., fabric, and level of what happened here? to ensure proper cleaning. Operate commercial washers, dryers, and pressing equipment...  ...the right suppliesneatly and efficiently. Support general housekeeping by keeping public areas tidy and jumping in where needed. What... 

Randstad Technologies

Remote - Rhapsody Certified Healthcare Interface Developer Job at Randstad Technologies

 ...interfaces that connect hospitals, clinics, laboratories, and public health agencies. This is a hands-on role, focused on developing,...  ..., and data integrity challenges. Collaborate with clinical informatics teams, IT staff, and public health stakeholders to define and... 

ABB

Crane Operator- 2 Job at ABB

 ...responsibilities (Mandatory) In this role, you will have the opportunity to operate process equipment or machinery to convert raw materials or semi-...  ...manual, work schedule, and/or production order instructions. Crane Operator will be trained on all steps of the job Stretching... 

DermaVe Spa

Junior Register Nurse Job at DermaVe Spa

 ...Job Title Junior Register Nurse Med Spa Wellness Team Employment Type ~ Full-Time Pay Range ~$19$25/hour (based on experience) About the Role Are you a new or early-career RN ready to dive into the world of aesthetics and wellness? Join our... 

Compass Group

JANITOR (FULL TIME AND PART TIME) Job at Compass Group

 ...and part time JANITOR positions. Location : Rogers Public Schools - 2710 North Woods Lane, Rogers, AR 72756. (Openings at other locations...  ...Service Provider. As a member of Compass Group we create clean, safe, and distraction free learning environments for students of...