Big Data Engineer

2 weeks ago


pune, India Pixeldust Technologies Full time
Job Description
We are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and robust data solutions.
Key Responsibilities:
Develop, maintain, and optimize scalable data pipelines and systems.
Collaborate with cross-functional teams to gather requirements and deliver data solutions.
Implement data models for both relational and NoSQL databases.
Utilize big data technologies to process and analyze large datasets.
Ensure data quality, integrity, and security across all stages of the data lifecycle.
Leverage cloud services for data storage, processing, and management.
Requirements :
Programming Languages: Proficient in Scala and Python with a strong understanding of object-oriented programming (OOP). Scala experience is preferred.
Big Data Technologies: Extensive experience with Spark, Hive, and Elasticsearch.
Cloud Platforms: Hands-on experience with Google Cloud Platform (GCP) and cloud services such as Dataproc, Amazon EMR, S3, and Google Cloud Storage (GCS).
Serverless Computing: Experience with managed serverless services or Kubernetes (K8s).
Data Modelling: Strong skills in data modeling for both relational and NoSQL databases.
Benefits :
Competitive salary and comprehensive benefits package.
Opportunities for professional development and career advancement.
Dynamic and supportive work environment.
  • Data Engineer

    1 month ago


    Pune, India Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...

  • Senior Data Engineer

    4 months ago


    pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Senior Data Engineer

    4 months ago


    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...


  • pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Big Data Engineer

    2 weeks ago


    Pune, India Mig Staffing Full time

    We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production system.To ensure success as a big data...

  • Big Data Engineer

    2 weeks ago


    Pune, India Pixeldust Technologies Full time

    Job Description We are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

  • Big Data Engineer

    2 weeks ago


    Pune, India Pixeldust Technologies Full time

    Job DescriptionWe are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

  • Big Data Engineer

    4 days ago


    pune, India Pixeldust Technologies Full time

    Job DescriptionWe are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

  • Big Data Engineer

    4 days ago


    pune, India Pixeldust Technologies Full time

    Job Description We are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

  • Big Data Engineer

    2 weeks ago


    Pune, India Pixeldust Technologies Full time

    Job DescriptionWe are seeking an experienced and highly skilled Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, building, and operationalizing large-scale data processing systems. This role requires expertise in a wide range of technologies and methodologies, with a strong emphasis on delivering scalable and...

  • Big Data

    3 months ago


    Pune, India Virtusa Full time

    **Duties & Responsibilities**: - Requirement Analysis, Design, Develop and Deploy project/tasks while adhering to existing SDLC standards. - Provide project/task effort estimates. - Provide regular project progress & Issue report. - Partner with multiple teams to deliver projects. - Scope and deliver various Big Data solutions. - Ability to design solutions...

  • Big Data Engineer

    2 weeks ago


    Pune, India Mig Staffing Full time

    Job Description : We are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with development teams, build cloud platforms, and maintain the production :- Meeting with managers...

  • Big Data Developer

    4 weeks ago


    Pune, India Solytics Partners Full time

    Job Description:We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Big Data Analytics, Hadoop, and Data Lake technologies. You will be responsible for designing, implementing, and maintaining large-scale data processing systems, ensuring the efficient flow and storage of data within our...

  • Big Data Developer

    3 weeks ago


    Pune, India Solytics Partners Full time

    Job Description: We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in Big Data Analytics, Hadoop, and Data Lake technologies. You will be responsible for designing, implementing, and maintaining large-scale data processing systems, ensuring the efficient flow and storage of data within...

  • Big Data Engineer

    2 months ago


    Pune, India Techno Wise Full time

    Position : Big Data EngineerRelevant Experience : 5+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...

  • Big Data Administrator

    4 months ago


    Pune, India TransUnion Full time

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: We’re looking for a Big Data Administrator to join our growing Big Data Administration team. You will be based both from our offices in Leeds and working remotely as part of our ‘flex together’ approach. In this fast-paced role you’ll work with Data Engineering and Data Science teams to...

  • Big Data Engineer

    3 months ago


    pune, India Draftmason Enterprises Full time

    Designation : Big Data EngineerExperience : 5 - 8 YearsSalary Range : upto 30 LPAJob Location : Kharadi, PuneType Of Employment : FT, PermanentWorking Mode : Hybrid (3 days WFO)Working Days : Mon - FriReports To : Director - Data EngineeringThe Opportunity : We are looking for talented, motivated, and self-driven Big Data Engineers who specialize in...


  • Pune, India Wissda Consulting Pvt Ltd Full time

    Job Description : Function : Software Engineering - Big Data / DWH / ETL, QA / SDETPython Big Data Automation TestingResponsibilities :- Testing big data ingestion and aggregation flows using spark shell and related queries- Developing automation framework using programming languages such as python and automate the big data workflows such as ingestion,...

  • Intern - Big Data

    3 months ago


    Pune, Maharashtra, India Seagate Technology Full time

    **About our group**: We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business...

  • Intern - Big Data

    3 months ago


    Pune, Maharashtra, India Seagate Technology Full time

    **About our group**: We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business...