Sr Big Data Engineer

2 weeks ago

Delhi, India Rackspace Full time
About the Role:

We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively.

What you will be doing

Build a reusable, and reliable code for stream and batch processing systems at scale. This includes working with technologies like Pub/Sub, Kafka, Kinesis, DataFlow, Flink, Hadoop, Pig, Hive, and Spark. Implementing automation/DevOps best practices for CI/CD, IaC, Containerization, etc.Requirements:

Job Title: Sr Big Data Engineer (GCP) - Airflow and OozieAbout the Role:We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in Oozie, the Apache Hadoop ecosystem, Airflow, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment, requiring excellent communication skills and the ability to solve complex problems independently and creatively.What you will be doing- Develop scalable and robust code for batch processing systems. This includes working with technologies like Hadoop, Oozie, Pig, Hive, Map Reduce, Spark (Java), Python, Hbase- Develop, Manage and optimize data workflows using Oozie and Airflow within the Apache Hadoop ecosystem- Leverage GCP for scalable big data processing and storage solutions- Implementing automation/DevOps best practices for CI/CD, IaC, etc.Requirements:- Experience with GCP managed services and understanding of cloud-based batch processing systems are critical.- Proficiency in Oozie, Airflow, Map Reduce, Java- Strong programming skills with Java (specifically Spark), Python, Pig, and SQL- Expertise in public cloud services, particularly in GCP.- Proficiency in the Apache Hadoop ecosystem with Oozie, Pig, Hive, Map Reduce- Familiarity with BigTable and Redis- Experienced in Infrastructure and Applied DevOps principles in daily work. Utilize tools for continuous integration and continuous deployment (CI/CD), and Infrastructure as Code (IaC) like Terraform to automate and improve development and release processes.- Ability to tackle complex challenges and devise effective solutions. Use critical thinking to approach problems from various angles and propose innovative solutions.- Worked effectively in a remote setting, maintaining strong written and verbal communication skills. Collaborate with team members and stakeholders, ensuring clear understanding of technical requirements and project goals.- Proven experience in engineering batch processing systems at scale.- Hands-on experience in public cloud platforms, particularly GCP. Additional experience with other cloud technologies is advantageous.

Must Have:

Must Have- Google Associate Cloud Engineer Certification or other Google Cloud Professional level certification- 10+ years of experience in customer-facing software/technology or consulting- 5+ years of experience with “on-premises to cloud” migrations or IT transformations- 5+ years of experience building, and operating solutions built on GCP (ideally) or AWS/Azure- Technical degree: Computer Science, software engineering or relatedAbout Rackspace Technology

We are the multicloud solutions experts. We combine our expertise with the world’s leading technologies — across applications, data and security — to deliver end-to-end solutions. We have a proven record of advising customers based on their business challenges, designing solutions that scale, building and managing those solutions, and optimizing returns into the future. Named a best place to work, year after year according to Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission to embrace technology, empower customers and deliver the future.

More on Rackspace Technology

Though we’re all different, Rackers thrive through our connection to a central goal: to be a valued member of a winning team on an inspiring mission. We bring our whole selves to work every day. And we embrace the notion that unique perspectives fuel innovation and enable us to best serve our customers and communities around the globe. We welcome you to apply today and want you to know that we are committed to offering equal employment opportunity without regard to age, color, disability, gender reassignment or identity or expression, genetic information, marital or civil partner status, pregnancy or maternity status, military or veteran status, nationality, ethnic or national origin, race, religion or belief, sexual orientation, or any legally protected characteristic. If you have a disability or special need that requires accommodation, please let us know.

  • Sr Big Data Engineer

    4 days ago

    Delhi, Delhi, India Rackspace Full time

    About the Role:We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment,...

  • Big Data Engineer

    2 weeks ago

    Delhi, India Awign Expert Full time

    Job DescriptionThis is a remote position.Job Title: Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered...

  • Big Data Engineer

    4 days ago

    Delhi, Delhi, India Awign Expert Full time

    Job DescriptionThis is a remote positionJob Title:Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin...

  • Big Data Engineer

    4 days ago

    Delhi, Delhi, India Programming Full time

    Job Title : Big Data EngineerLocation : RemoteAbout Us :We are a leading specializing in software development . Our team is dedicated to leveraging cutting-edge technologies to deliver scalable and efficient solutions to our clients globally.Role Overview :We are seeking a highly skilled Big Data Engineer with a strong background in designing and developing...

  • Big Data Engineer

    2 months ago

    Delhi, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: 6 - 10 YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Sr Big Data Engineer

    4 weeks ago

    Delhi, India Rackspace Full time

    About the Role:We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing and scaling both stream and batch processing systems, and a solid understanding of public cloud technologies, especially GCP. This role involves working in a remote environment,...

  • Big Data Engineer

    1 week ago

    Delhi, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Duration:6 MonthLocation:RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 YearsResponsibilitiesCreate and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open...

  • Big Data Developer

    3 days ago

    Delhi, India Trigent Software Inc Full time

    Hiring for a Senior Big Data Engineer Role : Senior Big Data Engineer should have a strong background in Scala, Spark, Python, Unix, and SQL with a minimum of 6 years of relevant experience.Location : Mumbai(Looking for candidates currently in Mumbai only)Notice period : Immediate Joiners onlySkill Set: Spark & Has to have developmentexperience Master's...

  • Big Data Engineer

    4 days ago

    Delhi, Delhi, India OmegaHires Full time

    Job Title: Big Data Engineer (Cornerstone to Lumi migration)Duration: Full-time on OmegaHires Payroll Location: NCR (Hybrid - 3 days Onsite per week) Should understand the Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data Owners, build...

  • Data Engineer

    1 month ago

    Delhi, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Role: Data EngineerExperience: 2+YearsNotice period: ImmediateLocation: Anywhere from IndiaJob Type: Full TimeResponsibilities:Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations & data governanceResponsible for...

  • Data Engineer

    2 weeks ago

    Delhi, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Role: Data EngineerExperience: 2+YearsNotice period: ImmediateLocation: Anywhere from IndiaJob Type: Full TimeResponsibilities:Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations & data governanceResponsible for...

  • Freelance Big Data Engineer

    2 months ago

    Delhi, India Leading MNC Full time

    Looking for aFreelance Big Data Solutions Engineerto join a team of rockstar developers. The candidate should have aminimum of 4+experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...

  • Freelance Big Data Engineer

    2 months ago

    delhi, India Leading MNC Full time

    Looking for a Freelance Big Data Solutions Engineer to join a team of rockstar developers. The candidate should have a minimum of 4+experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report...

  • Digital Engineering Sr. Engineer

    4 days ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:273690NTT DATA Services is looking for a Digital Engineering Sr. Engineer to join their team in Delhi, India.Responsibilities: Manage and maintain the Appworx/UC4 batch scheduling system Create and modify job schedules as required Monitor job execution and ensure accuracy and timeliness Troubleshoot any issues during job execution Collaborate with...

  • Big Data Engineer

    1 day ago

    delhi, India Taiyō.AI Full time

    We empower the people who build the world.Taiyō.AI is the world's largest infrastructure construction data-mesh technology and the first AI platform for the global infrastructure construction industry. Our clients include some of the largest construction firms, suppliers, and government.About The TeamWe are looking for Big Data Engineer to help support and...

  • Architect : Big Data

    4 days ago

    Delhi, Delhi, India Databricks Full time

    As aSolutions Architect(Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be atechnical advisorinternally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Azure Big Data Architect

    2 weeks ago

    delhi, India Tiger Analytics Full time

    Job TitleAzure Big Data ArchitectLocation : Chennai, Hyderabad, BangaloreWho we areTiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to push the...

  • Freelance Big Data Engineer

    3 days ago

    Delhi, Delhi, India Leading MNC Full time

    Looking for aFreelance Big Data Solutions Engineerto join a team of rockstar developers. The candidate should have aminimum of 4+experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you You will report into...

  • Data Engineer –

    2 weeks ago

    Delhi, India HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Data Engineer –

    2 months ago

    Delhi, India HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...