Job Description

*Assessment required - Hadoop, Cloudera, AWS migration (CO - Lead Cloudera/Hadoop Migration Engineer)

(Cloudera Hadoop Stack - HDFS, Hive, Spark, Oozie. Other skills like Amazon EMR, Amazon Glue, Apache Airflow)

Migration project where we are looking for somebody who has experience working on initiatives
Cloudera architecture (AWS)
Experience migrating from on prem to AWS
Experience with Hadoop

Bachelor's Degree in Computer Science, Information Technology, Information Systems, or related field.
10+ years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws.
The ideal candidate will possess deep expertise in both on-premises Hadoop ecosystems and modern cloud-native big data solutions on AWS.
Hands-on experience with Cloudera Hadoop stack (HDFS, Hive, Spark, Oozie, Python)
Proficiency in writing, maintaining, and troubleshooting shell scripts (Bash or similar) for automation and operational support.
Migration to AWS will need
- Analyze existing Cloudera Hadoop architecture, workflows, and data pipelines.
- Develop a comprehensive migration strategy to transfer data, processing logic, and applications to AWS services.
- Design target architecture using AWS big data services such as Amazon EMR, Airflow, Glue, Lambda.
- Evaluate and select appropriate AWS tools for data ingestion, storage, processing, and analytics.
- Oversee the migration process, including data transfer, application re-platforming, and validation.
- Ensure the new architecture meets performance, scalability, reliability, and security requirements.
- Collaborate with developers, data engineers, DevOps, and stakeholders to ensure a seamless migration.
- Create detailed technical documentation and migration runbooks.
- Mentor team members on AWS big data best practices.
- Strong understanding of data security, compliance, and governance in the cloud.
- Proven track record of migrating or modernizing big data workloads to AWS.
- Experience with cloud automation and Infrastructure as Code (e.g. Terraform).
- AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Big Data Specialty) are highly desirable.

Job Tags

Similar Jobs

Careerscape

Accounts Payable Clerk Job at Careerscape

...Careerscape is hiring an Accounts Payable Clerk to support the finance team by processing invoices, maintaining accurate financial records, and ensuring timely payments to vendors. In this fully remote position, you'll review invoices, reconcile accounts, resolve payment...

Veolia

Meter Reader Job at Veolia

...Boston, Veolia has more than 10,000 employees working at more than 350 locations across North America. Position Purpose: The Meter Reader will be a key part of the SourceOne energy management team responsible for collecting meter information and maintaining good...

LRS TRANSPORTATION SOLUTIONS

Delivery Driver Non CDL Job at LRS TRANSPORTATION SOLUTIONS

...with an excellent benefit package also. Drivers would pick up freight and deliver locally... .... ~$1100 averageweekly pay ~ No experience needed ~ Home daily ~ AM start time... ...needed ~ Training provided Straight truck Delivery and installation of appliances...

Deblock

Regulatory Compliance Officer Job at Deblock

...is also welcome! Scaling Experience: track record of managing compliance in an entity that operates across multiple EU borders.... ...bank holidays)~ Option to work 100% remotely or come to the office - your choice!~ Ability to work abroad for 4 months a year...

Southwest Human Development

Head Start Teacher Job at Southwest Human Development

...for continued professional growth and development. # Supportive and collaborative work environment. Job title: Teacher- Head Start & Early Head Start Program Join our team as a Head Start Teacher and make a meaningful impact on young minds! We're seeking...

Lead Cloudera/Hadoop Migration Engineer Job at 1 point system, New York, NY

cHNrSVBwSk04OG9XMmhiSC9Kd1B4SVFYTkE9PQ==