Senior Big Data Developer

16 hours ago

Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Big Data Engineer Wanted

We are seeking a skilled Data Engineer to lead our distributed data systems. The successful candidate will be responsible for designing, executing and managing large and complex distributed data systems.

The ideal candidate will have experience in big data technologies (Apache Hadoop) and relational databases (MySQL/PostgreSQL). Proficiency in at least one of the following programming languages - Java, Python or Scala is also required.

In addition, the candidate should have expertise in SQL (T-SQL/PL-SQL/HIVE-QL) and Apache Spark, with hands-on knowledge of working with Data Frames, Data Sets, RDDs, Spark SQL/PySpark/Scala APIs with deep understanding of Performance Optimizations.

Good analytical and quantitative skills are essential, as well as comfort working with very large sets of data.

The role requires experience with integration of data across multiple data sources and a good understanding of distributed computing principles.

Main Responsibilities:

  • Designing, execution and management of large and complex distributed data systems.
  • Monitoring performance and optimizing existing projects.
  • Researching and integrating Big Data tools and frameworks as needed.
  • Understanding business/data requirements and implementing scalable solutions.
  • Creating reusable components and data tools for all teams.

Key Requirements:

  • 2 to 4 years of experience in big data technologies (Apache Hadoop) and relational databases (MySQL/PostgreSQL).
  • Proficiency in at least one of the following programming languages - Java, Python or Scala.
  • Expertise in SQL (T-SQL/PL-SQL/HIVE-QL).
  • Proficiency in Apache Spark, including Data Frames, Data Sets, RDDs, Spark SQL/PySpark/Scala APIs.
  • Strong analytical/quantitative skills and comfortable working with large data sets.
  • Experience with integrating data from multiple sources.
  • Good understanding of distributed computing principles.

  • Senior Big Data Expert

    5 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data ExpertAs a senior big data expert, you will be responsible for designing and implementing large-scale data systems.Key Responsibilities:Design and implement high-performance data warehouses using Trino (PrestoSQL).Develop and maintain complex SQL queries to optimize database performance.Collaborate with cross-functional teams to...

  • Big Data Systems Developer

    17 hours ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a Data Systems Developer to design, build, and maintain large-scale data processing systems using Big Data technologies.Key Responsibilities:Design and develop scalable data processing systems.Collaborate with cross-functional teams to identify business requirements and design data pipelines.Analyze complex data sets to inform...

  • Lead Big Data Analyst

    5 days ago

    Kurnool, Andhra Pradesh, India beBeeDataScientist Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Data Scientist RoleWe are seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will be working with large datasets to gain valuable insights and drive business growth through data-driven decisions.Key Responsibilities:Create and implement complex data models to process and analyze big dataDesign and optimize efficient data...

  • Strategic Big Data Solutions Specialist

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer PositionWe are seeking a highly skilled Big Data Engineer to fill a key role in our organization.Design and implement large-scale big data solutions using technologies such as PySpark, Hive, Spark, HBase, and DQ tools to drive business growth and success.Develop and maintain scalable data pipelines to ingest data from disparate sources onto...

  • Senior Big Data Specialist

    3 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines that enable our company to make data-driven decisions.About the Role:Design and develop scalable data pipelines using Hadoop, Spark,...

  • Big Data Cloud Solutions Specialist

    16 hours ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Architect - Big Data ExpertAt the heart of our organization lies a pivotal role that demands expertise in managing complex data environments. As a Cloud Architect with specialization in Big Data, you will be responsible for designing and implementing cutting-edge cloud solutions.Key Responsibilities:Develop hybrid cloud architectures to migrate...

  • Senior Data Engineering Expert

    16 hours ago

    Kurnool, Andhra Pradesh, India beBeeData Full time US$ 1,50,000 - US$ 2,00,000

    Job Title: Senior Big Data EngineerWe are seeking a highly skilled and experienced Senior Big Data Engineer to join our team. This is an exciting opportunity for a talented professional to lead data engineering teams across geographies and time zones.Manage cross-team collaboration with architects, product managers, and operations.Design and implement...

  • Advanced Hadoop Big Data Solutions Engineer

    16 hours ago

    Kurnool, Andhra Pradesh, India beBeeBigDataDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Overview:We are seeking a highly skilled Hadoop Big Data Developer to fill this key role.About the Position:This is an opportunity to work with large-scale data processing using Hadoop and its ecosystem tools.The ideal candidate will have hands-on experience with Scala, Spark, Hive, and other Big Data Eco System Tools.Strong SQL skills are required,...

  • Chief Data Architect

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Engineering Leadership OpportunityWe are seeking an experienced engineering leader to oversee the development of scalable data pipelines and analytics platforms. The ideal candidate will lead a team of talented data engineers, leveraging expertise in Big Data platforms, Microsoft Azure, and Databricks.About the Role:Lead a team of data engineers working on...

  • Senior Big Data Developer

    4 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 28,00,000

    We are looking for a skilled Data Architect with expertise in designing and developing scalable data engineering solutions using Azure technologies.Key ResponsibilitiesDesign and Develop ETL PipelinesImplement Data Transformation WorkflowsWork with Azure Cloud ServicesTroubleshoot Job FailuresOptimize Data Processing JobsCollaborate with TeamsDevelop...