Senior Big Data Engineer

4 weeks ago


MumbaiPuneKolkataDelhiNagpurAhmedabad, IN AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

Position - Senior Big Data Engineer (GCP)

Experience - 5 to 8 Yrs

Location - Remote

Shift - EST Shift 5:30 PM to 2:30 AM

We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics. This role requires excellent data analysis skills and the ability to architect solutions for cloud-based environments, with a focus on extracting, processing, and analyzing data from diverse sources.

Key Responsibilities :

- Design, develop, and optimize Big Data pipelines and workflows using Hadoop, Hive, PySpark, and Google BigQuery.

- Architect data solutions to facilitate smooth data migration and processing between on-premises systems and Google Cloud Platform (GCP).

- Create and manage Unix Shell Scripts for process automation and data handling tasks.

- Perform in-depth data analysis and work comfortably with large datasets to derive actionable insights.

- Collaborate effectively with cross-functional teams to understand data requirements and translate them into scalable data solutions.

- Ensure data quality, integrity, and security across all stages of the data lifecycle.

- Stay updated with the latest industry trends and emerging technologies to continuously improve data solutions.

Mandatory Qualifications :

- Minimum of 8 years of industry experience working with Big Data technologies.

- Proficiency in Hadoop, Hive, and PySpark for data processing.

- Strong experience with Unix Shell Scripting.

- Expertise in SQL and extracting data from multiple sources.

- Demonstrated experience in data analysis, specifically querying and analyzing large datasets on Hadoop HDFS using Hive and Spark.

- Proven experience in architecting Big Data pipelines and data solutions.

- Proficiency in Google BigQuery and migrating data pipelines to GCP.

- Exceptional communication skills for clear requirement gathering and collaboration.

Preferred Qualifications :

- Google Cloud Platform (GCP) certification.

- Professional experience with cloud hosting platforms, with a preference for GCP.

(ref:hirist.tech)
  • Big Data Engineer

    2 months ago


    Hyderabad/Pune/Delhi NCR, IN Ace Recruit Full time

    Job Description :As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data ingestion...

  • Big Data Engineer

    2 months ago


    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, IN GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Description : Big Data Engineer - Scala, SparkYears of exp: 6 to 13 yearsJob location: Chennai / Hyderabad / Bangalore / Pune / Mumbai / Delhi / CoimbatoreAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be...

  • Big Data Engineer

    2 months ago


    Bangalore/Pune/Mumbai/Chennai, IN a client of change leaders Full time

    Job Description : - 5+ years of experience developing scalable Big Data applications or solutions on distributed platforms- Design and implement data pipelines using Snowflake, PostgreSQL, and Python.- Experience in AWS/ Azure/ GCP and good to have other cloud platform tools- Experience working with Big Data platforms, including Hadoop- Hive, Data Bricks...

  • Big Data Engineer

    2 months ago


    Chennai/Pune, IN Pan Asia Man power Consultants Recruiting agency Full time

    Job Title : Big Data EngineerExperience Range : 6+ YearsLocation : Chennai/Pune (Hybrid - 2 Days Work From Office in a Week)Job Description :We are seeking a skilled Big Data Engineer to join our Agile team and contribute to building backend data applications and services that support our analytics platforms. This role requires a hands-on developer with...

  • Big Data Engineer

    2 months ago


    Chennai/Noida/Gurgaon/Gurugram/Mumbai, IN ANRI Solutions HR Services Full time

    Role : Big Data Engineer Looking for an experienced Spark and Scala developer able to create an end-to-end data pipeline.Associate should be self-driven, can work with minimal guidance and guide the team technically. Job Details : 1. Expertise in Spark framework with scala language and Pyspark 2. Expertise in ETL and Data Warehousing and cloud concepts 3....

  • Big Data Engineer

    6 months ago


    Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, IN ATech Full time

    Designation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...


  • Bangalore/Gurgaon/Gurugram/Nagpur, IN Intuitive Apps Full time

    As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include :Hadoop Installation and Deployment :- Install Hadoop in Linux environments.- Deploy and maintain Hadoop clusters.- Monitor cluster health to ensure continuous uptime.- Analyze storage...

  • Big Data Developer

    2 months ago


    Pune/Gurgaon/Gurugram, IN Talent Toppers LLP Full time

    Responsibilities :- Undertake complete ownership in accomplishing activities and assigned responsibilities across all phases of project lifecycle to solve business problems across one or more client engagements;- Apply appropriate development methodologies (e.g.: agile, waterfall) and best practices (e.g.: mid-development client reviews, embedded QA...

  • Big Data Team Lead

    2 months ago


    Bangalore/Chennai/Pune, IN Rigel networks Full time

    Job Title : Senior Software Developer / Applications Development ManagerLocation : Pune, Chennai, Bangalore Shift Timings : 10 AM - 7 PMPosition Overview : We are seeking an experienced Senior Software Developer / Applications Development Manager with a strong background in software development and project management. The ideal candidate will possess...

  • Hadoop Administrator

    5 months ago


    Mumbai/Bangalore/Bhubaneshwar/Anywhere in India/Multiple Locations, IN Tehno Right Full time

    Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...


  • Navi Mumbai/Pune/Bangalore, IN Techno Wise Full time

    Job Summary : We are seeking a highly skilled and motivated individual to join our team as a Senior Azure Data Engineer. The ideal candidate will have a strong background in Azure data technologies, a proven track record of ability to design and implement scalable and efficient data solutions.Responsibilities :- Design, develop, and deploy data pipelines and...


  • Pune/Gurgaon/Gurugram/Bangalore, IN ZS Full time

    Comapany Description :ZS is a place where passion changes lives. As a management consulting and technology firm focused on transforming global healthcare and beyond, our most valuable asset is our people. Here you'll work side-by-side with a powerful collective of thinkers and experts shZS is a place where passion changes lives. As a management...

  • Data Engineer II

    2 months ago


    Bangalore/Pune/Mumbai/Coimbatore/Delhi NCR/Delhi/Navi Mumbai, IN Concept Management Full time

    Role - Data Engineer 2Job Type - Full-time, Permanent Qualification - BE or BtechNumber Of Roles - 15Location - Bangalore, Pune, Mumbai, Delhi, Gurugram, CoimbatorePackage - 15 to 20 LPAExperience - 3.5 to 6 YearsShift - UK Shift15 to 30 Days JoinerSkills : Data Engineering, Big data, ETL, Python, PySpark and SparkSQ, SQL, JIRA, Git, and GitHub.Job Summery...


  • Remote/Pune, IN TVARIT Full time

    JD of Senior Data Engineer : TVARIT GmbH develops and delivers solutions in the field of artificial intelligence (AI) for the Manufacturing, automotive, and process industries. With its software products, TVARIT makes it possible for its customers to make intelligent and well-founded decisions, e.g., in forward-looking Maintenance, increasing the OEE and...

  • Hadoop Administrator

    6 months ago


    Jaipur/Ahmedabad/Anywhere in India/Multiple Locations, IN ATech Full time

    Job Profile : Hadoop AdministratorWFH and WFO (Hiring Office Jaipur and Ahmedabad)Role: Big Data EngineerIndustry Type: IT Services & ConsultingJob description :- Good understanding of SDLC and agile methodologies- Installation and configuration of Hadoop clusters, including HDFS, MapReduce, Hive, Pig, HBase, and other related tools- Managing and monitoring...


  • Bangalore/Chennai/Pune/Gurgaon/Gurugram/Kolkata, IN Tredence Analytics Solutions Private Limited Full time

    Job Description :Job Title : Senior GCP Data EngineerSkills required : GCP, GCS, Dataproc, Airflow, Python/ Java/ SparkNotice period : Only Immediate to 15 days joinersHybrid role from Bangalore, Chennai, Gurgaon, Pune, Kolkata Job Requirement :- Have Implemented and Architected solutions on Google Cloud Platform using the components of GCP- Experience with...

  • Senior Data Engineer

    2 months ago


    Chennai/Bangalore/Pune/Hyderabad/Kolkata/Noida/Mumbai/Gurgaon/Gurugram/Jaipur/Delhi NCR, IN Zenfinet Solutions Private Limited Full time

    Chennai, Bangalore, Pune, Hyderabad, Kolkata, Noida, Mumbai, Gurgaon, Jaipur, New Delhi (Any of these Locations based on candidate's Choice)Notice period : 0- 30 days (Strictly Serving Notice period must apply)Job Description :- Design, build, and maintain robust and scalable data pipelines using AWS services like S3, Glue, EMR, and Redshift.- Develop...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad/Ahmedabad, IN Staffington Consulting Pvt Ltd Full time

    Job Description :Are you ready to elevate your career and make a real impact? We're on the hunt for passionate, driven Snowflake Data Engineer who thrive in a dynamic environment and are eager to bring fresh ideas to the table.Position : Senior Data Engineer - Snowflake (SnowSQL, Snowpipe, Snowpark are mandatory)Location : Hyderabad, AhmedabadExperience...

  • Senior Data Engineer

    1 month ago


    Delhi NCR/Gurgaon/Gurugram, IN AJ Consulting Full time

    Title : Senior Data EngineerJob Location : GurgaonEducation : B.TECH / MTECH Experience : 5 + Payroll : Nippon Data Systems LtdNIPPON DATA SYSTEMS LIMITED is a provider of IT enabled business solutions which provide our clients competitive business advantage. We partner with our customers to deliver business solutions to their satisfaction and help them...

  • Senior Data Engineer

    2 months ago


    Bangalore/Chennai/Hyderabad/Pune, IN Capabiliq IT Services Private Limited Full time

    As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual Contributor, team member and Data Modeling lead as demanded by each project to define, design, and deliver actionable insights.On a typical day, you might...