Highly Skilled Data Engineer Wanted

2 days ago

Anand, Gujarat, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 30,00,000
Job Title

As a Data Scientist, you will play a crucial role in designing and building data systems that power innovative products.

Key Responsibilities:

  • Develop and maintain optimal data architecture to ensure seamless data flow and efficient processing.
  • Design and implement event-based architectures to handle real-time data processing and stream processing systems.
  • Collaborate with cross-functional teams to identify and automate manual processes, optimize data delivery, and redesign infrastructure for greater scalability.
  • Develop expertise in big data tools, including HDFS/S3, Spark/Flink, Hive, HBase, Kafka/Kinesis, relational SQL, NoSQL databases (Elasticsearch, Cassandra/Mongodb), and data pipeline management tools (Azkaban, Luigi, Airflow).
  • Stay up-to-date with emerging technologies and industry trends to drive innovation and improvement in our data systems.

Requirements:

  • Proficiency in either Scala or Python, with strong hands-on experience in Apache Spark and performance tuning/optimization.
  • Expertise in DBT (Data Build Tool) for data transformations and modeling.
  • Experience working with cloud services (AWS/GCP) and object-oriented/object function scripting languages (Java, Scala).
  • Strong analytical skills and ability to work with structured/unstructured datasets.
  • Excellent communication and collaboration skills to work effectively with cross-functional teams.

Preferred Qualifications:

  • Contributions to open-source projects and/or published research papers.
  • Experience working on product companies and maintaining a few weekend side projects on GitHub.

  • Highly Skilled AWS Data Engineer Wanted

    3 days ago

    Anand, Gujarat, India beBeeCloud Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: AWS Data EngineerJob Description: We are seeking an experienced AWS Data Engineer to design, develop, test and support data pipelines and applications on the AWS platform.Design and implement robust ETL pipelines using PySpark, focusing on performance, scalability and data quality.Develop and maintain applications using Python and PySpark for data...

  • Highly Skilled Kafka Engineer Wanted

    5 days ago

    Anand, Gujarat, India beBeeKafka Full time ₹ 1,00,00,000 - ₹ 1,20,00,000

    We are seeking a highly skilled Kafka engineer to work on a leading banking project. The role involves upgrading the Service Mesh, migrating Kafka clusters, and ensuring secure integration in a restricted environment.Key Responsibilities:Upgrade Service Mesh from version 2.0 to 3.0 on production clusters.Migrate Kafka from Mirror Maker & Zookeeper to KRaft...

  • Highly Skilled Software Developer Wanted

    1 week ago

    Anand, Gujarat, India beBeeSoftwareDevelopment Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Role OverviewWe are seeking a highly skilled professional to fill the role of Software Development Engineer in Test.The ideal candidate will have strong experience in continuous integration and deployment, as well as hands-on expertise with REST API calls and JSON data handling.Key Responsibilities:Develop and implement automated testing processes using...

  • Highly Skilled Cloud Data Architect

    1 week ago

    Anand, Gujarat, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Databricks Data Engineer to join our dynamic data engineering team.The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code.Key Responsibilities:Design and develop scalable and high-performance data pipelines using Databricks and PySpark.Implement and manage...

  • Big Data Engineer

    2 days ago

    Anand, Gujarat, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 18,00,000

    Scalable Data Engineering Solutions Expert WantedWe are seeking a highly skilled data engineer to design, architect, and implement scalable data engineering solutions.Data Architecture and Development: Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.Data Pipelines: Build and maintain data...

  • Highly Skilled Electrical Professional Wanted

    5 days ago

    Anand, Gujarat, India beBeeElectrician Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:We are seeking a skilled Electrical Engineer to join our team.The ideal candidate will have a degree in Electrical Engineering and a minimum of 5+ years of relevant engineering experience in oil & gas, refinery, and petrochemical sectors.Main Responsibilities:Design Development: Design main electrical equipment and materials, including...

  • Highly Skilled Azure Data Migration Specialist

    3 days ago

    Anand, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Sr. Azure Data Engineer Job Overview">Job Description: We are seeking a highly skilled Azure Data Engineer to lead the migration of large-scale SQL workloads from on-premise environments to Azure. The ideal candidate will have hands-on experience in modern data engineering tools and platforms within the Azure ecosystem, including data integration,...

  • Highly Skilled Test Engineer Wanted

    3 days ago

    Anand, Gujarat, India beBeeTestEngineering Full time ₹ 12,00,000 - ₹ 15,00,000

    Key to a successful software development team is having skilled test engineers who can ensure high-quality products. In this role, you will be responsible for developing and executing comprehensive testing strategies.Job Requirements:Developing and maintaining automated testing scripts using Cypress and TypeScriptCreating test cases and conducting functional...

  • Highly Skilled Frontend Developer Wanted

    3 days ago

    Anand, Gujarat, India beBeeFrontend Full time ₹ 15,00,000 - ₹ 20,00,000

    About the JobWe are seeking a highly skilled frontend developer to drive innovation in our web application.Elevate an existing front-end web application using Micro-frontend architecture and Angular, pushing the boundaries of performance and scalability.Design and develop the backbone of a front-end implementation, crafting reusable components and features...

  • Highly Skilled Automation Test Engineer

    1 day ago

    Anand, Gujarat, India beBeeAutomation Full time ₹ 9,00,000 - ₹ 18,00,000

    Job Description:We are seeking a highly skilled and experienced test engineer to join our software development team.The ideal candidate will have a strong understanding of software testing methodologies, tools, and processes, as well as experience working with test automation frameworks and CI/CD pipelines.Proven track record of writing clear test...