Big Data Developer

22 hours ago

Pune Hyderabad Secunderabad Telangana, India beBeeData Full time US$ 90,000 - US$ 1,20,000
Job Description:

We are seeking an experienced Big Data Professional to join our team. The ideal candidate will have a strong background in developing and implementing data pipelines using cloud native technologies.

Key Responsibilities:

  • Collaborate with business stakeholders and architects to design and develop data pipelines
  • Develop and maintain large-scale data processing systems using Hadoop, Spark, and related frameworks
  • Work with public cloud environments, particularly AWS, to design and deploy scalable data solutions
  • Implement data warehousing and ETL processes using various tools and technologies
  • Design and implement real-time data streaming architectures using Kafka and other tools
  • Develop and deploy workflows using Apache Airflow and other orchestration tools
  • Perform performance and scalability tuning for data systems

Required Skills and Qualifications:

  • Strong experience in Python, Pyspark, Scala, Java, and SQL programming languages
  • Extensive experience working with Hadoop, Spark, Hive, Sqoop, and other related processing frameworks
  • Experience working in public cloud environments, particularly AWS
  • Ability to design and implement data warehouses and ETL processes
  • Experience with real-time data streaming architectures using Kafka and other tools
  • Hands-on experience with workflow orchestration tools like Apache Airflow
  • Proficiency in Agile/Scrum application development using JIRA

Nice to Have:

  • Experience with Teradata and Snowflake data platforms
  • Proficiency in source control, merging strategies, and coding standards
  • Demonstrated experience developing in CI/CD environments using tools like Jenkins and CircleCI
  • Ability to maintain build and deployment processes using integration tools
  • Experience designing instrumentation into code and using logging analysis tools like log4Python and New Relic

  • Big Data Developer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    **Job Title:** Big Data DeveloperWe are seeking a skilled and experienced Big Data Developer to join our team.As a Big Data Developer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Spark and Java. You will work with our team of experts to create efficient and scalable solutions that meet the...

  • Big Data Engineer

    1 day ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to design and develop scalable data processing solutions using Apache Spark and related technologies.About the Role:This role involves working on large-scale data processing, real-time analytics, and building efficient data pipelines for various business use cases.Critical Skills:Create...

  • Big Data Engineer

    1 day ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer - Big DataWe are seeking an experienced Senior Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies, excellent programming skills, and the ability to work independently as well as mentor junior developers.Key Responsibilities:Design and develop large-scale data processing pipelines...

  • Senior Big Data Engineer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time

    Big Data Engineer PositionWe are seeking a skilled big data engineer to join our organization in India. The ideal candidate will have a strong background in data engineering with extensive experience in building and maintaining large-scale data pipelines and infrastructure to support our business decisions.Key ResponsibilitiesDesign, develop, and maintain...

  • Big Data Developer

    1 day ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time

    Job Title: Big Data DeveloperWork Location: Hyderabad, Telangana (TG), IndiaExperience Range: 6–8 YearsSkill Area: Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-driven Big Data Developer to join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing,...

  • Big Data Developer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    2 days ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Leading Big Data Architectures

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    Senior Data Engineer Position OverviewWe are seeking a seasoned data engineer to lead the development of our big data infrastructure. The ideal candidate will have extensive experience with Databricks, DLT, and PySpark.Job DescriptionThe Senior Data Engineer will be responsible for designing, implementing, and maintaining large-scale data pipelines using...

  • Big Data Engineer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThis role involves working on large-scale big data platforms to design, implement, and optimize ETL pipelines for storing and processing contract information from upstream sources. The successful candidate will have experience in Spark ETL, big data storage, and querying techniques.Key Skills and Qualifications6+ years of experience in Spark ETL...

  • Senior Big Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Job Title: Data Solutions DeveloperWe are seeking a talented Data Solutions Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data solutions that drive business growth.About the Role:This is an exciting opportunity to work on complex data-related challenges and...