Senior Big Data Developer

1 day ago

Ahmedabad, Gujarat, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

Job Title: Data Engineer II


Job Description:

The team designs, executes, and manages large-scale distributed data systems. These systems are built to handle high volumes of requests across multiple topics.


What We Do:

We use cutting-edge technologies like Machine Learning and AI to achieve our goals. Our tech stack includes Java, Elastic Search/Solr, Kafka, Spark, and more.


Key Responsibilities:

  • Design and execute large-scale distributed data systems.
  • Monitor and optimize existing projects.
  • Research and integrate new Big Data tools and frameworks.
  • Understand business and data requirements and implement scalable solutions.
  • Create reusable components and data tools for all teams.


Requirements:

To be successful in this role, you will need:

  • 2-4 years of experience in big data technologies (Apache Hadoop) and relational databases (MS SQL Server/Oracle/MySQL/Postgres).
  • Proficiency in at least one programming language (Java, Python, or Scala).
  • Expertise in SQL (T-SQL/PL-SQL/SPARK-SQL/HIVE-QL).
  • Proficiency in Apache Spark, including working with Data Frames, Data Sets, RDDs, and Spark SQL/PySpark/Scala APIs.
  • Good understanding of Distributed Storage (HDFS/S3).
  • Strong analytical/quantitative skills and comfortable working with very large datasets.
  • Experience integrating data across multiple data sources.
  • Good understanding of distributed computing principles.


Nice to Have Skills:

  • Experience with Message Queues (e.g., Apache Kafka).
  • Experience with MPP systems (e.g., Redshift/Snowflake).
  • Experience with NoSQL storage (e.g., MongoDB).


  • Big Data Professional

    6 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data AnalystA senior big data analyst position is available for a highly skilled professional to leverage their knowledge of big data analytics and drive business outcomes. The ideal candidate will have experience working with large datasets, developing and implementing data-driven solutions, and collaborating with cross-functional teams.Key...

  • Senior Big Data Engineer

    7 days ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 30,00,000

    Job Title: Senior Big Data Engineer">We are seeking a highly skilled Senior Big Data Engineer to join our team.">About the Role:">This is an exciting opportunity for an experienced engineer to lead the development of large-scale data processing systems using Apache Spark, Python and AWS services.">Key Responsibilities:">- Design and implement scalable data...

  • Senior Big Data Architect

    1 day ago

    Ahmedabad, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,01,00,000

    Effective Data Engineering is crucial for any organisation's success. This role requires a Senior Data Engineer to lead the development and implementation of large-scale data architectures.We are looking for an experienced professional who can design and develop complex big data systems, ensuring scalability and performance.Data Architecture: Proven...

  • Big Data Developer

    1 day ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock the Power of Big Data with Us!Job DescriptionWe are seeking a skilled Big Data Hadoop Scala developer to join our team. As a key member, you will be responsible for architecting, developing, and maintaining our big data ecosystem.Key Responsibilities:Hands-on experience in Scala, Spark, Hive, and Hadoop Big Data Eco System Tools is essential.Strong...

  • Big Data

    6 days ago

    Ahmedabad, Gujarat, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Specialist

    1 day ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Big Data Specialist to join our team.Responsibilities:Analyze and process large data sets using Big Data technologiesDevelop and implement scalable data pipelinesWork with cross-functional teams to deliver high-quality solutionsRequirements:2+ years of experience in Big Data engineeringStrong skills in Scala, AWS, and...

  • Big Data Governance Leader

    1 day ago

    Ahmedabad, Gujarat, India beBeeDataGovernance Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Governance ProfessionalOur team is seeking a seasoned Data Governance Specialist to play a key role in designing and implementing big data-based data governance solutions. This position involves technical leadership across the full life cycle of data projects from requirement gathering and analysis to platform selection, design of the...

  • Principal Big Data Engineer

    1 day ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Specialist RoleAbout the Position:As a key member of our data analytics team, you will be responsible for designing and implementing big data solutions using Scala Spark.Key Responsibilities:Design and implement big data solutions using Scala Spark.Develop and maintain complex data pipelines.Work with large datasets and ensure efficient data...

  • Big Data Analytics Expert

    6 days ago

    Ahmedabad, Gujarat, India beBeeBigDataAnalytics Full time ₹ 25,00,000 - ₹ 30,00,000

    About the RoleWe are seeking an experienced professional to join our team as a Big Data Analytics Expert. This role will involve working with large datasets and developing scalable solutions using Apache Druid.Key ResponsibilitiesDesign, develop, and maintain high-performance data pipelines using Apache Druid.Collaborate with cross-functional teams to...

  • Chief Big Data Engineer

    7 days ago

    Ahmedabad, Gujarat, India beBeeAzure Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data and Azure Engineering Leadership OpportunityThis leadership role focuses on developing and managing high-performing data engineering teams, overseeing the creation of end-to-end data solutions using Azure Data Services and Databricks.The ideal candidate will lead cross-functional teams, collaborating with stakeholders to understand requirements and...