Big Data Developer

3 days ago

bangalore, India BayOne Solutions Full time

Job Description: We are seeking a highly skilled Full Stack Big Data Engineer to join our team. The ideal candidate will have strong expertise in big data technologies, cloud platforms, microservices, and system design, with the ability to build scalable and efficient data-driven applications. This role requires hands-on experience across data engineering, backend development, and cloud deployment, along with a strong foundation in modern DevOps and monitoring practices. Key Responsibilities: Design, build, and optimize big data pipelines using Scala, PySpark, Spark SQL, Spark Streaming, and Databricks. Develop and maintain real-time data processing solutions using Kafka Streams or similar event-driven platforms. Implement cloud-based solutions on Azure, leveraging services such as Azure Data Factory (ADF) and Azure Functions. Build scalable microservices with Core Java (8+) and Spring Boot. Collaborate on system design , including API development and event-driven architecture. Contribute to front-end development (JavaScript, React) as needed. Ensure application reliability through monitoring tools such as Grafana, New Relic, or similar. Utilize modern CI/CD tools (Git, Jenkins, Kubernetes, ArgoCD, etc.) for deployment and version control. Work cross-functionally with data engineers, software developers, and architects to deliver high-quality solutions. Qualifications: 5+ years of professional experience as a Software/Data Engineer or Full Stack Engineer. Strong programming skills in Scala, Python, and Java . Experience with Databricks, Spark SQL, Spark Streaming , and PySpark . Hands-on experience with Azure cloud services and data engineering tools. Solid knowledge of microservices development with Spring Boot. Familiarity with event-driven platforms such as Kafka. Experience with CI/CD pipelines and containerization/orchestration tools. Strong problem-solving and communication skills. Bachelor’s or master’s degree in computer science, Engineering, or a related field (preferred). Nice to Have: Experience with API design and event-driven architecture . Frontend development experience with React and JavaScript .

  • Big Data Developer

    3 days ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!!TCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.Your role is of key importance, as it lays down the foundation for the entire project.Position: Bigdata DeveloperJob Location: BangaloreExperience: 6-12...

  • Big Data Developer

    2 weeks ago

    bangalore, India Tata Consultancy Services Full time

    Greetings from TCS!!We are hiring for Bigdata & Hadoop DeveloperJob location: Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, GurgaonDesired experience: 4 to 10 yearsRequired Technical Skill Set: HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, AutosysMust-Have:Hands-on experience in Big data, Hadoop Hands-on experience in...

  • Big Data Engineer

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Big Data Engineer

    3 days ago

    bangalore, India Alef Education Full time

    Who we areAlef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.Today, Alef is proudly...

  • Big Data Engineer

    2 days ago

    bangalore, India Alef Education Full time

    Who we are Alef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe. Today, Alef is proudly...

  • Gcp big data engineer

    3 weeks ago

    Bangalore, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments. Key...

  • Gcp big data engineer

    1 week ago

    Bangalore, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments. Key...

  • Big Data Engineer – Azure

    3 days ago

    bangalore, India Innova ESI Full time

    Role: Big Data Engineer – AzureExperience: 10+ YearsLocation: Bangalore Immediate Joiners OnlyBig Data :Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, experience in IT industry, including 5 years in...

  • Big data + azure engineer

    2 weeks ago

    Bangalore, India Innova ESI Full time

    Role: Big Data + Azure Engineer Location: Bangalore Experience: 12+ years Notice: Immediate Job Description: Mandatory Skills: Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big Data Optional Skills: Airflow, Python Roles & Responsibilities Overall, 12 years of experience in IT...

  • Sre & devops (big data)

    2 weeks ago

    Bangalore, India ITC Infotech Full time

    SRE & Devops (Big Data) Location : Bangalore Mode: Hybrid Required Skills: ● Demonstrated ability in designing, building, refactoring and releasing software written in Java, Python. ● Strong experience with Big Data technologies including Hadoop, Spark, Flink, Hive, HDFS. ● Ability to handle data integration, bug fi xing, performance optimization,...