Big Data Developer

5 days ago

Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000

Job Title: Data Engineer

Job Description:

  • We are seeking an experienced data engineer to develop, construct, test and maintain large volumes of structured and unstructured data pipelines in Google Cloud.
  • The ideal candidate will design and build complex datasets based on business requirements and leverage a variety of tools in the Google Cloud Ecosystem such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage.
  • The role involves identifying opportunities for data acquisition via working with stakeholders and business clients, translating business needs to technical requirements, and leveraging DevOps and CI/CD practices to ensure the reliability and scalability of data pipelines.
  • We are looking for someone who can use logs & alerts to effectively monitor pipelines, partition/cluster and retrieve content in Big Query, and use IAM roles & Policy Tags to secure the data.
  • The successful candidate will also be responsible for designing and building an ingestion pipeline using Rest API, recommending ways to improve data quality, reliability, and efficiency.
  • Required Skills and Qualifications:
    • Expertise in developing, constructing, testing and maintaining large volumes of structured and unstructured data pipelines in Google Cloud.
    • Familiarity with tools like Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage.
    • Ability to identify opportunities for data acquisition and translate business needs to technical requirements.
    • Experience with DevOps and CI/CD practices and ability to ensure the reliability and scalability of data pipelines.
    • Knowledge of logs & alerts, partition/cluster, and IAM roles & Policy Tags.
    • Ability to design and build an ingestion pipeline using Rest API and recommend ways to improve data quality, reliability, and efficiency.
  • Benefits:
    • Opportunity to work with a highly skilled team of engineers.
    • Chance to learn and grow professionally.
    • Competitive salary and benefits package.
  • Others:
    • This is a challenging and rewarding role that requires strong technical skills, attention to detail, and excellent communication skills.
    • The ideal candidate will have a passion for innovation and a commitment to delivering high-quality results.

  • Big Data Architect

    1 week ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Big Data ArchitectWe are seeking a highly skilled Big Data Architect to design, develop, and optimize large-scale data pipelines and distributed data processing systems.The ideal candidate will have a proven track record in building scalable cloud-based data architectures using Scala, Spark, Python, Apache Kafka, and NiFi.

  • Big Data Solutions Lead

    4 days ago

    Amrāvati, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Big Data DeveloperWe are seeking a highly skilled Senior Big Data Developer to lead our big data development initiatives.Key Responsibilities:Analyzing complex data requirements and designing scalable solutions using Spark, Scala, and PySpark.Developing and deploying high-quality code in onshore-offshore working mode.Collaborating with...

  • Big Data Solutions Expert

    1 week ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Unlock your expertise in data processing and analytics as a Big Data Engineer.Key Responsibilities:Develop scalable big data solutions using PySpark and Hive to drive business growth.Collaborate with cross-functional teams to integrate big data platforms with other systems, ensuring seamless data flow.Work closely with data scientists and analysts to build...

  • Senior Big Data Architect

    1 day ago

    Amrāvati, Maharashtra, India beBeeDataiku Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Dataiku, PythonWe are seeking a highly skilled Big Data Administrator to manage our big data platform. The ideal candidate will possess in-depth knowledge of Hadoop, Hive, HBase, and BigSQL ecosystems.Administer and monitor Big Data Platform components including Hadoop, Hive, HBase, BigSQL, etc.Support technical and application teams with data...

  • Big Data Analyst

    5 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer - Big DataWe are seeking an experienced Data Engineer to fill a crucial role in our organization.Key Responsibilities:Develop and maintain large-scale data processing systems using advanced data technologies such as Scala, Python, or Java.Collaborate with cross-functional teams to gather requirements, define project scope, and ensure...

  • Big Data Expert

    1 day ago

    Amrāvati, Maharashtra, India beBeeBigData Full time US$ 1,80,000 - US$ 2,00,000

    Job SummaryWe are seeking a Big Data Engineer to join our team.The ideal candidate will have experience with data platform design, roll out and evolution. They will provide technical leadership to the engineering organization and liaison with product teams, professional services and sales engineers on solution and trade-off reviews.Key...

  • Big Data Platform Visionary

    1 week ago

    Amrāvati, Maharashtra, India beBeeDataLeader Full time US$ 1,25,000 - US$ 1,75,000

    Job OverviewWe are seeking a visionary leader to spearhead the development of a cutting-edge big data platform.Align with key client initiatives to drive strategic growth and collaboration

  • Senior Big Data Specialist

    2 weeks ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data EngineerSynopsis:As a seasoned data engineer, you will be responsible for designing and developing large-scale data processing systems using distributed computing frameworks like PySpark.Our ideal candidate is an expert in Big Data technologies, with hands-on experience in Python, AWS, and Spark.Mandatory Skills:PythonPySparkAWSBonus...

  • Big Data Engineer Role

    22 hours ago

    Amrāvati, Maharashtra, India beBeeData Full time US$ 1,20,000 - US$ 1,70,000

    Job Title: Data EngineerWe are seeking an experienced data engineer to join our team. The ideal candidate will have a strong background in designing and building scalable data pipelines, as well as experience working with big data technologies such as Apache Beam, Cloud Functions, and BigQuery.Create high-quality, scalable data pipelines using a variety of...

  • Big Data Expert with Hadoop and Scala Experience

    5 days ago

    Amrāvati, Maharashtra, India beBeeHadoop Full time ₹ 20,00,000 - ₹ 30,00,000

    Unlock Your Potential as a Big Data ExpertAbout the RoleWe are seeking an experienced data scientist with expertise in big data, Hadoop, and Scala. If you have hands-on experience of Scala, Spark, Hive, and Hadoop big data ecosystem tools, we'd love to hear from you.As a key member of our team, you will be responsible for developing, tweaking queries, and...