Big Data Developer

1 week ago

Bengaluru, Karnataka, India Talpro Full time

Job Description :

We are seeking immediate joiners (available to start in May) for the role of Big Data Developer (Python / PySpark).

The ideal candidate will have 58 years of industry experience, with at least 3+ years of hands-on work in Big Data technologies.

You will play a key role in building and maintaining scalable data pipelines, supporting streaming data use cases, and collaborating with business and engineering teams on architectural and technical decisions.

Key Responsibilities :

- Design, develop, and maintain scalable Big Data solutions using Python and PySpark.

- Build and optimize data pipelines to process large volumes of structured and unstructured data.

- Work with streaming services such as Kinesis, Kafka, or equivalent to support near real-time data processing.

- Integrate with NoSQL data stores such as HBase, DynamoDB, etc.

- Develop data processing jobs using Hadoop ecosystem tools such as Spark, Hive, Nifi, Flink, and Spark Streaming.

- Write complex SQL queries and leverage analytical SQL functions for data analysis and transformations.

- Participate in architectural discussions and make key technical decisions to improve data platform performance and reliability.

- Collaborate with cross-functional teams to understand business requirements and deliver high-quality data solutions.

Required Skills & Experience :

- 5 - 8 years of overall industry experience.

- Minimum 3+ years of hands-on experience in Big Data technologies.

- Strong programming experience in Python and PySpark; familiarity with Scala is a plus.

- Experience with Big Data streaming services such as Kinesis, Kafka, or similar.

- Experience with NoSQL data stores such as HBase, DynamoDB, etc.

- Solid understanding and hands-on experience with the Hadoop ecosystem, including Spark, Hive, Nifi, Flink, Spark Streaming, etc.

- Strong SQL skills, including writing complex queries and using analytical functions.

- Proven experience participating in business, architectural, and technical decision-making.

Nice to Have :

- Experience with AWS, Azure, or other cloud platforms.

- Familiarity with CI/CD pipelines for data engineering.

- Exposure to data security, governance, and compliance best practices.

Behavioural Competencies :

- Strong problem-solving and analytical skills.

- Excellent communication and collaboration abilities.

- Ability to work independently and in a team-oriented, collaborative environment.

- Ownership mindset with the ability to deliver under tight timelines

(ref:hirist.tech)

  • Big Data Developer

    5 days ago

    Bengaluru, Karnataka, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewA full-stack developer is required to work on big data projects.Key ResponsibilitiesDevelop Java Full Stack + Big Data applicationsDesign and implement scalable architectures for large-scale data processingCollaborate with cross-functional teams to identify and prioritize project requirementsSkills and QualificationsProficiency in Java, Spring...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India Nasugroup Full time

    Job Description :We are seeking a highly motivated and experienced Big Data Developer. You will be responsible for designing, developing, and implementing scalable and efficient big data solutions. The ideal candidate will possess strong expertise in Big Data technologies, particularly Spark and Scala, and have hands-on experience with cloud platforms. As an...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Myhashtagss Full time

    Job Description :We are seeking a highly skilled Big Data Developer with expertise in Hadoop, Python, and PySpark to join our team on a 12-month contract-to-hire basis. In this role, you will be responsible for designing and implementing scalable big data solutions, ensuring the efficient processing of large datasets in a distributed computing environment....

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: BangaloreExperience:5-10 Years- Required Technical skills: Bigdata, Hadoop Technologies- 4+ years of experience in Big Data, Hadoop- Sound Knowledge...

  • Senior Big Data Developer

    1 week ago

    Bengaluru, Karnataka, India beBeeData Full time

    Big Data Engineer RoleBig data engineering involves designing and developing scalable big data solutions using PySpark. As a big data engineer, you will work on large datasets, ensuring data quality, and implementing efficient data processing techniques.Job Responsibilities:Design and Develop Scalable Big Data SolutionsDevelop big data solutions using...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Grid Dynamics Full time

    Key ResponsibilitiesDesign and develop scalable data pipelines to migrate user knowledge objects from Splunk to Click House and Grafana.Implement data ingestion, transformation, and validation processes to ensure data integrity and performance.Collaborate with cross-functional teams to automate and optimize data migration workflows.Monitor and troubleshoot...

  • Big Data Developer

    4 weeks ago

    Bengaluru, Karnataka, India Impetus Full time

    Impetus Technologies is seeking a skilled Java + Bigdata Engineer to join our dynamic team. The ideal candidate will possess strong expertise in Java programming and have hands-on experience with Bigdata technologies. If you are interested and can join us for Bangalore location. Please do share your resume at -vaishali.tyagi@impetus.comResponsibilities:-...

  • Big Data Developer

    2 weeks ago

    Bengaluru, Karnataka, India Mphasis Full time

    Job Title: Big Data Engineer TechPrimary Skills:- Hadoop (HDFS, Map-Reduce, YARN)- SPARK (SQL, DataFrame)- ETL/ELT (Professional experience with Teradata, Ab Initio)- Python or PySpark- MongoDB, GCP, Big Query- CI/CD, Hive- Unix, AutosysResponsibilities:- Design, develop, and test robust ETL/ELT data pipelines using Map-Reduce and SPARK.- Process large...

  • Big Data Developer

    3 weeks ago

    Bengaluru, Karnataka, India Maimsd Technology Full time

    Job DescriptionBig Data Developer - Spark/HadoopWe are seeking an experienced Big Data Developer with expertise in Hadoop, Spark, and Kafka to take complete ownership of the software development lifecycle, from requirement gathering to final deployment. This role is ideal for a proactive individual who can translate business use cases into robust, scalable,...

  • Big Data Developer

    2 days ago

    Bengaluru, Karnataka, India beBeeBigDataDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking a skilled Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing and developing ETL and Hadoop applications, undertaking end-to-end project delivery, and ensuring that end-solutions meet business needs and expectations.About the Role:Design and development of ETL and...