Job Description

Roles/Responsibilities:

Conduct comprehensive data analysis, create data mappings, develop dashboards, and ensure data quality and integrity

• Leverage Spark SQL within Databricks to query and analyze large datasets, writing efficient and complex SQL queries
• Collaborate closely with data engineers to design and deliver high-quality data products
• Develop detailed data mappings to support the integration and transformation of data from diverse sources into structured, analysis-ready formats
• Design and build intuitive, informative dashboards using tools such as Power BI or Databricks' native visualization tools to effectively communicate insights
• Build Gold-layer data products to support custom-built dashboards, APIs, and UI tools
• Create clear and comprehensive documentation for data pipelines, mappings, models, and dashboard functionality
• Perform statistical analysis, data mining, and machine learning to uncover patterns, trends, and actionable insights

Mandatory Skills:

1. Databricks and PySpark proficiency: hands-on experience working in the Databricks platform and using PySpark for data analysis and transformation. -5 years
2. Advanced Spark SQL: the ability to write efficient, complex queries to analyze large datasets within Databricks. -5 years
3. Data visualization and dashboarding: building clear, intuitive dashboards in Power BI and Databricks' native visualization tools to communicate insight -5 years
4. Data mapping and modelling: developing detailed mappings that integrate and transform data -5 years
5. Business requirements and stakeholder collaboration: gathering and developing business requirements -5 years
6. Data quality and analysis: conducting thorough data analysis -5 years

Job Tags

Similar Jobs