Big Data Developer

1 day ago

Pune, Maharashtra, India Populace World Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Description : Big Data Developer

Location : Pune, India

Experience : 7 Years

About the Role :

We are seeking a highly experienced and technically proficient Big Data Developer to join our team in Pune. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing pipelines and platforms. The ideal candidate has a deep background in the modern data ecosystem, with expertise in Python, PySpark, and cloud-based data analytics services, and a proven ability to solve complex data transformation challenges.

Key Responsibilities :

- Big Data Development : Design, build, and maintain robust, scalable, and highly performant data pipelines using Python and PySpark.

- Data Architecture : Work extensively with core Big Data technologies, including Hadoop and Apache Spark, to process vast datasets.

- Platform Expertise : Leverage deep knowledge of the Databricks platform to manage and execute data workloads efficiently.

- Data Structuring : Implement best practices for data storage and querying, with extensive, hands-on experience utilizing Delta Tables and working with various file formats such as JSON and Parquet.

- Cloud Integration : Develop and deploy solutions leveraging AWS data analytics services.

- Problem Solving : Tackle and resolve complex data processing and transformation-related problems, ensuring data quality, accuracy, and performance.

- Database Management : Apply solid knowledge of both NoSQL and RDBMS databases in data ingestion and integration workflows.

- Collaboration : Utilize good communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and other engineering teams.

Required Qualifications :

- Experience : 7 years of professional experience as a Big Data Engineer or in a similar role.

- Programming Proficiency : Must be proficient with Python & PySpark.

- Core Big Data : In-depth, practical knowledge of Hadoop and Apache Spark.

- Data Lake/Warehouse Technologies : Extensive hands-on experience with Databricks and deep familiarity with Delta Tables.

- File Formats : Must have extensive experience working with and optimizing data stored in JSON and Parquet file formats.

- Database Knowledge : Solid understanding and working knowledge of both NoSQL and RDBMS databases.

- Analytical Skills : Proven ability to analyze and solve complex data processing, transformation, and optimization problems.

Desired/Good-to-Have Qualifications :

- Cloud Data Services : Experience with AWS data analytics services such as Athena, Glue, Redshift, and EMR.

- Data Warehousing : Familiarity and practical experience with Data Warehousing concepts and methodologies will be a plus.

  • Big Data Developer

    5 days ago

    Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Developer

    4 weeks ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Senior Big Data Developer

    1 week ago

    Pune, Maharashtra, India VR Consultancy Full time ₹ 10,000 - ₹ 30,000 per year

    We are looking for Big Data Engineers who can design, develop, and maintain big data solutions using Spark, Hadoop, PySpark, and other related technologies.Interested candidates can share their resumes

  • Big Data Lead

    6 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Architect

    5 days ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...

  • Big Data

    3 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India Impetus Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionYear of Experience - 1 to 3 yearsLocation - Indore, Pune, Noida, Hyderabad, Bangalore, GurugramRequired Skills:Python Programming: Strong ability to write clean and efficient code.Spark SQL: Good understanding of Spark SQL for distributed data processing.Data Processing: Experience with large datasets and structured data manipulation.SQL...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Persistent Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    About PersistentWe are a trusted Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many...