ETL Data Platform Developer Job at Cloud Analytics Technologies LLC, Redmond, WA

cHM4TE9KQk85czhTMmhmTitaZ0d3WU1hTlE9PQ==
  • Cloud Analytics Technologies LLC
  • Redmond, WA

Job Description

Summary

Role : ETL Data Platform Developer

Location : Redmond, WA (Onsite )


Key Responsibilities
Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql) and Azure Data Factory.
Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions.
Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools.
Ensure data quality, lineage, and governance across all ingestion and transformation processes.
Collaborate with product teams to understand data needs and deliver scalable solutions.
Optimize performance and cost across storage and compute layers.

Required Qualifications
7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies.

Strong expertise in:
Executive written and oral communication
Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)
Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
Power BI and/or other visualization tools
SQL, Python and PySpark/ Scala
Experience working with structured and semi structured data (JSON, XML, CSV, Parquet).
Proven ability to build metadata driven architectures and reusable components.
Familiarity with agent based architectures and conversational AI integration is a plus.
Strong understanding of data modeling, data governance, and security best practices.

Job Tags

Similar Jobs

Confidential

Accounting Specialist Job at Confidential

This is a REMOTE contract to hire opportunity for Accounting Associate, occasional onsite several times a month as needed. Provide accounting support within the accounting department including Accounts Payable, Accounts Receivable, posting journal entries, reconciliations... 

PAHrtners Deaf Services

Family Model Provider Job at PAHrtners Deaf Services

 ...We are hiring for: Family Model Provider Type: Family Model Provider (TN) - Independent Contractor If you are a positive and personable individual looking for a satisfying and fun opportunity to make a real difference in the lives of people with intellectual... 

UPMC Senior Communities

Professional Staff Nurse (RN) - (Medical Oncology/Clinical Research) - CTRC Job at UPMC Senior Communities

 ...performance of basic, translational, and clinical research, and the education of the next generation...  ...Full-Time Professional Staff Nurse (RN) to support the University of Pittsburgh...  ...with executives, managers, physicians, non-physician providers, ancillary and support... 

Resilient Inc.

Entry-Level Public Relations Assistant - Paid Training Job at Resilient Inc.

 ...Are you motivated, competitive, and ready to start a career in public relations and marketing? Our growing team is seeking enthusiastic, career-focused individuals for an Entry-Level Public Relations Assistant position with paid training and opportunities for professional... 

Marriott International

Assistant Pastry Chef Job at Marriott International

 ...quality products, presentations and flavor. Ensures compliance with all applicable laws and regulations. Assists the Executive Chef with menu development associated with Pastry. Operates and maintains all department equipment and reports malfunctions. ...