Big Data Developer

10 hours ago

Ahmedabad, Gujarat, India beBeeDataInfrastructure Full time ₹ 15,00,000 - ₹ 20,00,000
Data Infrastructure Specialist

We're looking for an experienced Data Infrastructure Specialist to lead the development and maintenance of our data pipelines. This is a critical role that requires a strong understanding of distributed data systems, cloud platforms, and data warehousing.

Key Responsibilities:

  • Design, develop, and manage end-to-end data pipelines that handle high-volume financial data.
  • Integrate third-party APIs and data feeds into internal systems.
  • Build and optimize data ingestion, storage, and transformation workflows (batch and real-time).
  • Ensure data quality, consistency, and reliability across all pipelines.
  • Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets.
  • Monitor, troubleshoot, and optimize pipeline performance.
  • Implement ETL/ELT best practices, data governance, and security protocols.
  • Contribute to the scalability and automation of our data infrastructure.

Requirements:

  • Proven experience as a Big Data Engineer / Data Engineer (preferably in financial or crypto domains).
  • Strong expertise in Python, SQL, and distributed data systems.
  • Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
  • Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
  • Knowledge of API integrations and handling real-time streaming data.
  • Familiarity with databases (relational and NoSQL) and data modeling.
  • Solid understanding of stocks, cryptocurrencies, and financial data structures (preferred).
  • Strong problem-solving skills with the ability to handle large-scale data challenges.

Benefits:

This role offers a unique opportunity to work on cutting-edge data infrastructure projects and collaborate with a talented team of engineers and data scientists. You will have access to advanced tools and technologies, and will be encouraged to contribute to the development of new features and improvements.

About the Position:

The successful candidate will have a strong background in data engineering, with experience working with big data technologies and cloud platforms. They will be able to design, build, and maintain complex data pipelines, and collaborate with cross-functional teams to deliver high-quality results.

  • Big Data Professional

    1 week ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data AnalystA senior big data analyst position is available for a highly skilled professional to leverage their knowledge of big data analytics and drive business outcomes. The ideal candidate will have experience working with large datasets, developing and implementing data-driven solutions, and collaborating with cross-functional teams.Key...

  • Big Data Developer

    5 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock the Power of Big Data with Us!Job DescriptionWe are seeking a skilled Big Data Hadoop Scala developer to join our team. As a key member, you will be responsible for architecting, developing, and maintaining our big data ecosystem.Key Responsibilities:Hands-on experience in Scala, Spark, Hive, and Hadoop Big Data Eco System Tools is essential.Strong...

  • Big Data

    1 week ago

    Ahmedabad, Gujarat, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Specialist

    5 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Big Data Specialist to join our team.Responsibilities:Analyze and process large data sets using Big Data technologiesDevelop and implement scalable data pipelinesWork with cross-functional teams to deliver high-quality solutionsRequirements:2+ years of experience in Big Data engineeringStrong skills in Scala, AWS, and...

  • Big Data Specialist

    2 days ago

    Ahmedabad, Gujarat, India beBeeDevelopment Full time ₹ 25,00,000 - ₹ 30,00,000

    About the Job:We are looking for a skilled Big Data Developer to join our team.Job Credentials- Experience: 5 to 12 yearsResponsibilities:Develop and maintain big data applications using Spark, SQL, Hive, and Scala.What We Offer:A competitive salary and benefits package.The opportunity to work with a talented team of professionals.Ongoing training and...

  • Principal Big Data Engineer

    5 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Specialist RoleAbout the Position:As a key member of our data analytics team, you will be responsible for designing and implementing big data solutions using Scala Spark.Key Responsibilities:Design and implement big data solutions using Scala Spark.Develop and maintain complex data pipelines.Work with large datasets and ensure efficient data...

  • Innovative Big Data Solutions Expert

    3 days ago

    Ahmedabad, Gujarat, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Developer PositionAs a key member of our data-driven organization, we are seeking an experienced Big Data Developer to join our team.The ideal candidate will have a proven track record of designing, developing, and implementing big data solutions using cutting-edge technologies such as Spark, Scala, and PySpark. The successful candidate will be...

  • Senior Big Data Developer

    5 days ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Job Title: Data Engineer IIJob Description:The team designs, executes, and manages large-scale distributed data systems. These systems are built to handle high volumes of requests across multiple topics.What We Do:We use cutting-edge technologies like Machine Learning and AI to achieve our goals. Our tech stack includes Java, Elastic Search/Solr, Kafka,...

  • Senior Big Data Architect

    24 hours ago

    Ahmedabad, Gujarat, India beBeeDataStrategist Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    The most impactful opportunity awaits!Job DescriptionWe are seeking an exceptional Big Data Strategist to spearhead the development of our Enterprise TruRisk Platform. This pioneering project aims to empower customers with unparalleled Cyber Risk Management capabilities.This role offers a chance to work closely with a talented team of engineers and...

  • Senior Big Data Engineer

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title: Senior Big Data Engineer">We are seeking a highly skilled Senior Big Data Engineer to join our team.">About the Role:">This is an exciting opportunity for an experienced engineer to lead the development of large-scale data processing systems using Apache Spark, Python and AWS services.">Key Responsibilities:">- Design and implement scalable data...