Senior Big Data Professional

1 week ago

Kottayam, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

About us: We provide digital engineering and technology services to clients worldwide. Our approach ensures we can execute all ideas and creatively solve business challenges.

Job Title : GCP Big Data Engineer

Key Skills : PySpark , Airflow , SQL , GCP

Job Locations : Gurugram

Experience : 5-10 years

Education Qualification : Any Degree Graduation

Work Mode : Hybird

Employment Type : Contract

Notice Period : Immediate - 10 Days

We are seeking a seasoned data analytics professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions.

The ideal candidate will design, develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support large-scale data analytics. They will utilize the Big Data Hadoop ecosystem to manage and process vast datasets efficiently.

The successful candidate will collaborate with cross-functional teams to gather requirements and deliver reliable data solutions. They will ensure data quality consistency and integrity across multiple data sources.

We are looking for a highly skilled data engineer who can monitor and troubleshoot data workflows to maintain high system availability and performance. The ideal candidate will stay updated with emerging trends and best practices in GCP data analytics and big data technologies.

Roles and Responsibilities:

  1. Implement and manage ETL processes leveraging GCP services such as BigQuery Dataflow and Airflow.
  2. Develop scalable, maintainable, and reusable data pipelines to support business intelligence and analytics needs.
  3. Optimize SQL queries and data models for performance and cost efficiency in BigQuery.
  4. Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities.
  5. Automate workflow orchestration using Apache Airflow for seamless data operations.
  6. Collaborate with data engineers, analysts, and stakeholders to ensure alignment of data solutions with organizational goals.
  7. Participate in code reviews, testing, and deployment activities adhering to best practices.
  8. Mentor junior team members and contribute to continuous improvement initiatives within the data engineering team.

Mandatory Skills : GCP Storage,GCP BigQuery,GCP DataProc,GCP Cloud Composer,GCP DMS,Apache airflow,Java,Python,Scala,GCP Datastream,Google Analytics Hub,GCP Workflows,GCP Dataform,GCP Datafusion,GCP Pub/Sub,ANSI-SQL,GCP Dataflow,GCP Data Flow,GCP Cloud Pub/Sub,Big Data Hadoop Ecosystem

We offer a contract employment type with immediate - 10 days notice period. The work mode is hybrid.

  • Big Data Analyst

    1 week ago

    Kottayam, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000

    About Big Data:As a highly skilled professional in the field of big data, you will play a key role in designing and implementing large-scale data processing systems using technologies such as Hadoop, Spark, and NoSQL databases.Key Responsibilities:Develop and maintain complex data pipelines to ensure seamless integration of data sources and...

  • Big Data Specialist

    1 week ago

    Kottayam, Kerala, India beBeeDataManagement Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionAs a Big Data Administrator, you will be responsible for managing big data platforms, handling day-to-day operations, and administering and monitoring components. Your expertise in Hadoop, Hive, HBase, and BigSQL will ensure seamless data management.Required Skills and QualificationsProven experience in managing big data platforms, including...

  • Senior Big Data Specialist

    2 weeks ago

    Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking an experienced Senior Data Engineer to lead the development and maintenance of large-scale data processing systems. The ideal candidate will have a strong background in designing, constructing, and optimizing complex data pipelines, as well as experience with cloud platforms and big data technologies.Key ResponsibilitiesData...

  • Big Data Engineer

    2 weeks ago

    Kottayam, Kerala, India beBeeData Full time US$ 7,50,000 - US$ 14,20,000

    Job Title: Big Data EngineerWe are seeking a skilled data engineer to join our team and help us harness the power of data. As a big data engineer, you will be responsible for designing and implementing scalable data pipelines using Azure Databricks.The ideal candidate will have strong experience with Apache Spark and Azure services such as Data Lake Storage...

  • Senior Big Data Professional

    1 week ago

    Kottayam, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title: Experienced Data EngineerWe are seeking a skilled professional with 3–4 years of experience in building, optimizing, and maintaining large-scale data processing solutions.The ideal candidate will contribute to the design and implementation of scalable data pipelines in cloud environments such as Azure using tools like Databricks, Apache Kafka,...

  • Big Data Systems Architect

    2 weeks ago

    Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:We are looking for a seasoned Data Engineer to spearhead the development of large-scale data processing systems using Big Data technologies.The ideal candidate will be responsible for designing, developing, and implementing scalable data pipelines using Big Data tools and technologies.Key Responsibilities:Design and develop data architectures...

  • Data Analytics Professional

    2 weeks ago

    Kottayam, Kerala, India beBeeBig Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Greetings from LTIMindtree.Job Title: Big Data SpecialistWe are currently hiring for a Big Data Specialist with expertise in Scala and Spark. The ideal candidate should have more than 5.8 years of experience in Big Data projects, including experience in Big Data technologies such as PySpark, Scala Spark, Java Spark SQL, and SQL.Key Responsibilities:

  • Unlock Your Potential as a Senior Data Professional

    2 weeks ago

    Kottayam, Kerala, India beBeeData Full time ₹ 20,91,000 - ₹ 27,21,250

    Senior Azure Data Engineer OpportunityWe are seeking a skilled Senior Azure Data Engineer to join our team. As a senior engineer, you will have the opportunity to work on high-profile projects and collaborate with top talent from around the world.Key responsibilities include:Developing and maintaining scalable data pipelines using Azure Data Factory and...

  • Big Data Developer

    1 week ago

    Kottayam, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a talented individual to fill the role of Data Analytics Expert.Key Responsibilities:Analyzing complex data sets to inform business decisionsDeveloping and implementing data-driven solutions using Spark and ScalaCollaborating with cross-functional teams to drive project successTroubleshooting technical issues and optimizing...

  • Cloud Data Engineer Position

    2 weeks ago

    Kottayam, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Cloud Data EngineerJob Description:We are seeking a highly skilled Senior Cloud Data Engineer to join our team. The ideal candidate will have 4+ years of experience in IT, with a strong background in diagnosis and troubleshooting complex issues.The role involves designing, implementing, and maintaining large-scale data pipelines using Google Cloud...