Job Description

Job Title: Lead Data Engineer
Location: Irving, TX - Hybrid

Must have:

Expert in Databricks, PySpark and Azure data services like ADF, Synapse etc.
Must have lead level experience
8+ years of professional data engineering experience, with proven technical leadership.
Deep understanding of Azure tech stack (Databricks, ADF, Key Vault, ASQL, ADLS Gen2, Service Principles etc.)
Deep experience with Databricks (design, optimization, notebooks, stored procedures, UDFs, etc).
Hands-on experience with ETL tools such as SSIS and Azure Data Factory.
Experience working with API calls and Ingesting data from external source systems
Experience with SQL, Python and PySpark
Experience with building dynamic and scalable solutions for data ingestion and curation
Experience in data engineering and MS SQL Server and T-SQL development.
Strong understanding of data lake/delta lake architectures and modern data pipelines.
Strong understanding of medallion architectures and design patterns.
Strong understanding of data modeling techniques.
Experience handling large-scale data volumes (millions of records).
Proficiency in building and maintaining CI/CD pipelines.
Experience with IaC technologies such as Terraform or Pulumi.
Exposure to big data tools (Spark, Hadoop, Kafka) preferred.
Experience with reporting tools such as Power BI or Tableau a plus.
Knowledge of .NET development beneficial for cross-team collaboration.
Prior experience working in an Agile development environment required.
Strong communication and collaboration skills with the ability to translate technical concepts to business partners.

What Success Looks Like:

You're the go-to technical lead for all things related to data design, integration, and performance.
You enable consistency and best practices across Azure, Databricks, SQL, ETL, and data engineering domains.
You mentor others while remaining hands-on with architecture and solution delivery.
You ensure the Internal Analytics platform continues to evolve as a reliable, scalable data source for the organization.

Job Tags

Similar Jobs

Sira

Data Center Technician (Cable Technician or Fiber Technician) Job at Sira

...The Fiber Technician installs racks, patch panels, fiber optics, and grounding for equipment and cables. Performs continuity testing on horizontal and riser cables using volt-ohmmeter and tone sets, and troubleshoots issues such as opens, crosses, shorts, and transposed...

YMCA

Housekeeping Staff - MALE - Weekends & Evenings Job at YMCA

...the comfort and safety of others? As a Housekeeper, and an important member of our team, you will perform all of the day-to-day cleaning services. This part-time position is for a MALE Housekeeper to work in our men's locker room on weekday nights and weekends....

Jovie of CA, WA, and MN

Experienced Nannies and Babysitters Wanted Job at Jovie of CA, WA, and MN

...door in the childcare industry and has sustained me living on my own. Glassdoor Job Benefits: Earn Reward points for gift... ...and repeat assignments My Jovie App for setting your schedule and keeping assignment details organized Opportunities for overtime...

REI (Recreational Equipment Inc.)

Facilities Associate Job at REI (Recreational Equipment Inc.)

Overview: REI Co-op is united around discovering, building and celebrating better ways of working in this world, all so that folks can find and pursue a love of the outdoors. When you work for the co-op, you do your best work with the support to live your best life...

Dartmouth Health

Registered Nurse (RN), Rehab - Per Diem Job at Dartmouth Health

...Education: Graduate of an accredited school of nursing as an RN and licensed in the State of Vermont. Experience: Clinical experience... ...Interest:Nursing; Work Status:As needed; Employment Type:Per diem; Job ID:3744 Dartmouth Health is an Affirmative Action and...

Lead Data Engineer Job at AIT Global inc., Irving, TX

M2MyUkNndWpmNTVnSThac1BPRWVkMzlpUkE9PQ==