Senior Cloud Data Engineer (GCP Data Fabric)
POSITION OVERVIEWWe are seeking a Senior Cloud Data Engineer to serve as the technical lead for a large-scale enterprise data migration and cloud modernization initiative. This individual will be responsible for migrating more than 100TB of business data from Cloudera Hadoop environments and AWS storage into Google Cloud Platform (GCP), helping build a modern Data Fabric centered around BigQuery.
The ideal candidate will have deep expertise in Cloudera, Hadoop ecosystems, cloud data engineering, and large-scale data migrations, along with experience building modern, scalable data pipelines using Medallion Architecture.
MUST-HAVE SKILLS Candidates should have most or all of the following:6+ years of Cloud Data Engineering experienceAdvanced experience with Cloudera (HDFS/Hive)Experience migrating large-scale enterprise data platformsStrong Google Cloud Platform (GCP) experienceExperience with BigQueryExperience building modern cloud data pipelinesExperience working with Hadoop ecosystems (HDFS, Hive)Experience with AWS data storage services (S3 and/or FSx)Experience designing and implementing Medallion Architecture (Bronze, Silver, Gold)Strong SQL and data engineering fundamentalsExperience optimizing large-scale data storage and processingExcellent troubleshooting and problem-solving skills
PREFERRED SKILLSData Fabric implementation experienceServerless data architectureData lake modernizationData governance and securityData quality and validation frameworksCI/CD for data engineeringInfrastructure as CodePython or Spark development experienceEnterprise cloud migration experience
CORE RESPONSIBILITIESCloud Data MigrationLead migration of over 100TB of enterprise data from Cloudera Hadoop environments into Google Cloud PlatformMigrate data from HDFS, Hive, AWS S3, and FSx into BigQueryValidate data integrity throughout migration activitiesOptimize storage, performance, and scalabilityData EngineeringDesign and develop modern cloud-native data pipelinesBuild scalable ingestion and transformation frameworksDevelop optimized BigQuery storage modelsSupport enterprise Data Fabric implementationPlatform ArchitectureDesign and implement Medallion Architecture (Bronze, Silver, Gold)Develop secure and scalable data movement frameworksImprove platform reliability, performance, and operational efficiencySupport cloud-native data engineering best practices
...SUMMARY OF JOB: Howard Hanna Mortgage is looking for motivated Loan Originators who want to contribute to Howard Hanna Mortgages mission of providing top level service to our clients, colleagues, and the communities we service. By actively researching loans for...
...Mail Sorter - Bensenville At Job&Talent, we are recruiting for a Mail Sorter to work with a leading logistics company in Bensenville. Be part of a team that plays a critical role in keeping the world moving forward by delivering what matters most. Shift Patterns...
...professional growth. At Tzadik, We Never Stop Growing! We are currently seeking a dedicated and detail-oriented Full-Time Groundskeeper/Janitor to join our team in Dickinson, ND. If you take pride in maintaining a clean and welcoming environment and are committed to...
Class A National Tour Driver Musical Organization Immediate HireThis position is driving for the Blue Knights Drum and Bugle Corps, an... ...tour beginning June 15 and ending August 15, 2018. Additional part-time opportunities year-round. Drivers are an important part of a...
...interests in each of BayLegals service counties and statewide. Our attorneys represent survivors in restraining order actions, child... ...three (3) days per week and may work remotely from home on a part-time basis. BayLegal employees are expected to reside in California...