Big Data Engineer

2 days ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title:

Big Data Engineer - Data Architect

Design, develop, and optimize complex data systems using Databricks.

Job Description

  • Develop scalable big data pipelines and ETL workflows using Databricks, Azure/AWS.
  • Implement high-performance data integration solutions for large datasets across diverse data sources.
  • Collaborate with data scientists, analysts, and stakeholders to deliver high-quality data solutions.
  • Monitor, troubleshoot, and optimize data workflows for performance and cost-efficiency.

Required Skills & Qualifications

  • Expertise in Spark, Python, Java, Scala, and associated data services.
  • Strong understanding of Data Lake/Data Warehouse/Lakehouse Concepts.
  • 3+ Years hands-on experience in SQL, Unix Shell Scripting, Kafka.
  • Experience in GIT, SVN, Build Tools like Ant, Maven, CI/CD pipelines.
  • Hands on file transfer mechanism (NDM, sFTP etc).
  • Knowledge of Schedulers like Airflow, TWS etc.

Educational Background

  • Bachelors or Masters degree in Computer Science, Engineering, or a related field.

  • Big Data Engineer

    5 days ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark) Location: Pune/Nagpur (WFO) Experience: 8 - 12 Years Employment Type: Full-time Job Overview We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Big Data Engineer (PySpark)Location:Pune/Nagpur (WFO)Experience:8 - 12 YearsEmployment Type:Full-timeJob OverviewWe are looking for an experiencedBig Data Engineerwith strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance...

  • Big Data Engineer

    1 day ago

    Pune, Maharashtra, India Merito Full time

    Job Description :We are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines for us to deal with the huge structured data sets that we use as an input to accurately generate analytics at scale for our valued Customers. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining,...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India LION AND ELEPHANTS CONSULTANCY PRIVATE LIMITED Full time

    Job Description : We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data environment at an enterprise scale application. You will work...

  • Big Data Engineer

    6 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer">We are seeking a highly skilled Big Data Engineer to drive the design and implementation of scalable data pipelines using Apache Spark, Databricks, or equivalent big data frameworks. This is an excellent opportunity for experienced professionals to join our organization and leverage their expertise to drive business outcomes through...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India WorkiFicient Full time

    To be successful in this role, you should possess : - Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data toolsand frameworks required to solve Big Data problems at scale.- Design and implement...

  • Big Data Engineer

    2 days ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title:Big Data EngineerAbout the RoleWe're seeking an experienced data engineer to lead the development of large-scale data processing pipelines using Apache Spark and related technologies.The ideal candidate will have a strong background in data warehousing, ETL concepts, and SQL/NoSQL operations.Familiarity with UNIX shell scripting for scheduling and...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India WorkiFicient Full time

    Roles and Responsibility :- Collaborate closely with Product Management and Engineering leadership to devise and build the right solution.- Participate in Design discussions and brainstorming sessions to select, integrate, and maintain Big Data tools and frameworks required to solve Big Data problems at scale.- Design and implement systems to cleanse,...

  • Senior Big Data Engineer

    2 days ago

    Pune, Maharashtra, India Devlats Pvt Ltd Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The RoleWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities :Design, develop, and maintain scalable and high-performance data...

  • Senior Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Devlats Pvt Ltd Full time

    About the Role : We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate will have strong expertise in designing, building, and optimizing data pipelines and architectures, as well as a solid understanding of big data tools and Responsibilities : - Design, develop, and maintain scalable and high-performance...