ETL Data Platform Developer Job at Cloud Analytics Technologies LLC, Redmond, WA

cHM4TE9KQk85czhTMmhmTitaZ0d3WU1hTlE9PQ==
  • Cloud Analytics Technologies LLC
  • Redmond, WA

Job Description

Summary

Role : ETL Data Platform Developer

Location : Redmond, WA (Onsite )


Key Responsibilities
Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql) and Azure Data Factory.
Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.
Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.
Ensure data quality, lineage, and governance across all ingestion and transformation processes.
Collaborate with product teams to understand data needs and deliver scalable solutions.
Optimize performance and cost across storage and compute layers.

Required Qualifications
7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.

Strong expertise in:
Executive written and oral communication
Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)
Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
Power BI and/or other visualization tools
SQL, Python and PySpark/ Scala
Experience working with structured and semi structured data (JSON, XML, CSV, Parquet).
Proven ability to build metadata driven architectures and reusable components.
Familiarity with agent based architectures and conversational AI integration is a plus.
Strong understanding of data modeling, data governance, and security best practices.

Job Tags

Similar Jobs

INTRADIN (SHANGHAI) IMPORT & EXPORT CO., LTD

Vietnam Finance Specialist / Cashier Job at INTRADIN (SHANGHAI) IMPORT & EXPORT CO., LTD

1. 1+ years of hands-on experience in cashiering or accounting (manufacturing industry preferred), with knowledge of Vietnam cash management and banking procedures.2. Proficiency in Vietnamese (required for basic bank/tax-related communication).3. Skilled in Excel and... 

Green Window Cleaning Services LLC

Rope Access Certified Commercial Window Cleaning Technician Job at Green Window Cleaning Services LLC

Green Window Cleaning Services, LLC is once again looking to expand and grow our team and is offering career positions. We are looking for applicants to join our team in Spring 2025.We are currently looking for Certified Rope Access Technicians (SPRAT or IRATA) Level...

Kraken

Data Analyst, Product Job at Kraken

 ...Kraken account here .As a fully remote company, we have Krakenites in...  ...of workThe team At Kraken, data is both a strategic asset and...  ...making.We're looking for a Data Analyst, Product to join our team...  ...leadership teams. Join us and be part of a team where data is not... 

DHL Group

Returns Processor Job at DHL Group

 ...Grow your skills. Shape your world. Role Purpose : Opens and verifies returned merchandise, scans merchandise, and places freight in proper locations. Key Accountabilities : Load, unload, move, stock, and stage product. May require using powered equipment... 

Damascus Home Care LLC

PSS CNA Part Time to Full Time Job at Damascus Home Care LLC

 ...companionshipRequirements:- Certified Nursing Assistant (CNA) certification-PSS (Personal Support Specialist)- Experience...  ...- Competitive compensation range of $18.5 - $23 per hour- Part-time to full-time opportunities available- Flexible schedulingAbout...