Lead Big Data Engineer

1 day ago

Dindigul, Tamil Nadu, India beBeeData Full time ₹ 30,00,000 - ₹ 40,00,000
Job Overview">

Senior Data Engineer Position Available

This position involves leading and managing large-scale data engineering initiatives. The ideal candidate will be responsible for designing, implementing, and maintaining complex data pipelines, as well as collaborating with cross-functional teams to drive business outcomes.

">Proficiency in either Scala or Python, expertise in Spark, experience with performance tuning and optimization, DBT knowledgeExperience with big data tools: HDFS/S3, Spark/Flink, Hive, HBase, Kafka/KinesisRelational SQL and NoSQL databases experience: Elasticsearch, Cassandra/MongodbExperience with data pipeline and workflow management tools: Azkaban, Luigi, AirflowAWS/GCP cloud services experience, stream-processing systems: Spark-Streaming/FlinkObject-oriented/object function scripting languages: Java, ScalaBuilding and optimizing 'big data' data pipelines, architectures, and data setsStrong analytical skills related to working with structured/unstructured datasetsMetadata, dependency, schema registration/evolution, workload managementMessage queuing, stream processing, highly scalable 'big data' data stores experience]Key Qualifications">
  • Strong leadership skills and ability to manage multiple projects simultaneously
  • Excellent communication and interpersonal skills
  • Ability to analyze complex technical problems and develop creative solutions
  • Experience with agile development methodologies and version control systems
  • Proficiency in at least one programming language and familiarity with relevant tools and technologies
What We Offer">
  • Competitive salary and benefits package
  • Opportunities for professional growth and development
  • Collaborative and dynamic work environment
  • Recognition and rewards for outstanding performance

  • Data Engineering Lead

    11 hours ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a skilled professional to lead our data engineering initiatives.As a seasoned data engineer, you will drive the development and continuous improvement of our Data/AI Practice.Design and implement scalable data projects using modern unified data platforms (e.g., Databricks, Snowflake)Implement ETL/ELT processes using SQL and...

  • Big Data Architect

    13 hours ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Big Data ArchitectAbout the Role:We are seeking an experienced professional to lead our data engineering efforts. As a Data Architect, you will be responsible for designing and building scalable data pipelines on modern cloud & big data platforms.Tech Stack:AWSPythonPySparkSQLKey Requirements:Programming Skills: Strong in Python, SQL, PySpark,...

  • Big Data Engineer

    7 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job DescriptionOur team is seeking a skilled professional to manage and maintain our big data platform. The ideal candidate will have hands-on experience with Apache Druid in production, as well as strong analytical skills.Key Responsibilities:Develop and implement efficient data models for real-time analytics using Apache Druid.Collaborate with...

  • Big Data Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Large Scale Data Systems EngineerJob Description:Design and execute large-scale distributed data systems to handle vast amounts of data. Collaborate with cutting-edge technologies on a large Hadoop cluster.Key Responsibilities:Design and manage complex distributed data systems.Monitor performance and optimize existing projects.Research and integrate Big Data...

  • Big Data Engineer for Scalable Data Pipelines

    3 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 50,00,000

    Job Overview:We are seeking an experienced Big Data Hadoop Scala developer to fill a key role in our team.Key Responsibilities:Design, develop, and deploy scalable data pipelines using Scala, Spark, and Hadoop Big Data Eco System Tools.Develop complex SQL queries to extract insights from large datasets.Work on performance enhancement of queries and data...

  • Big Data Processing Specialist

    3 days ago

    Dindigul, Tamil Nadu, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThe ideal candidate will be responsible for designing and developing large-scale data processing systems utilizing Big Data technologies like Scala, AWS, Python, or Java. Their primary goal is to extract valuable insights from vast datasets and present them in a clear and actionable manner.Design efficient data processing pipelines using Big Data...

  • Principal Big Data Scientist

    7 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Engineer RoleWe are seeking an experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems.Job DescriptionThe ideal candidate will have a strong background in computer science or a related field, with at least 3-6 years of experience...

  • Senior Big Data Specialist

    1 week ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Senior Big Data SpecialistWe are seeking an experienced professional to design, build, and maintain scalable data pipelines and ETL workflows using Spark and SQL.Main Responsibilities:Develop efficient data processing systems for large datasets.Create real-time streaming applications with Spark Streaming/Kafka.Collaborate with cross-functional...

  • Cloud Data Engineer Specialist

    3 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,20,000 - ₹ 20,36,520

    About UsWe are a leading provider of cloud data engineering solutions.Experience: 4-8 years in Cloud data engineering solutionsLocation: Bangalore, IndiaThe successful candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and be responsible for end-to-end implementation of cloud data engineering solutions like...

  • Cloud Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Cloud Architect - Big Data Solutions">We are seeking a skilled Cloud Architect to join our team. This is an excellent opportunity for someone with strong expertise in big data management and cloud adoption strategies.">Key Responsibilities:Design and implement effective big data architectures using Azure Cloud technologies.Collaborate with cross-functional...