GCP Big Data Engineer

3 weeks ago


Bareilly, India IntraEdge Full time

About the Role:

We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to build, deploy, and maintain scalable and reliable data pipelines for processing and analyzing large datasets.

Responsibilities:

  • Design, develop, and implement big data solutions using GCP services like BigQuery, Cloud Dataflow, Cloud Dataproc, and Cloud Storage.
  • Ingest, transform, and load (ETL) data from various sources into BigQuery for efficient data analysis.
  • Looking for a Data Engineer with strong expertise in Python and Big Data concepts to build, optimize, and scale data processing pipelines and solutions.
  • Develop and automate data pipelines using tools like Cloud Dataflow for large-scale data processing.
  • Manage and optimize big data infrastructure on GCP to ensure scalability, performance, and cost-effectiveness.
  • Configure and implement security best practices for big data storage and processing in GCP.
  • Monitor and troubleshoot big data pipelines and identify areas for improvement.
  • Work collaboratively with data scientists, analysts, and other engineers to translate data needs into technical solutions.
  • Stay up-to-date with the latest advancements in big data technologies and GCP services.

Qualifications:

  • 5+ years of experience in big data engineering or a related role.
  • Proven experience in designing and developing big data solutions on the cloud (preferably GCP).
  • Strong understanding of big data concepts (data lakes, data warehouses, distributed processing)
  • Expertise in GCP services for big data processing (BigQuery, Cloud Dataflow, Cloud Dataproc).
  • Experience with scripting languages like Python for data manipulation and automation.
  • Experience with cloud storage solutions (e.g., Cloud Storage) a plus.
  • Experience with data warehousing concepts and data modeling techniques (a plus).
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.



  • Bareilly, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Senior Engineer

    1 week ago


    bareilly, India Wipro Full time

    About the Company: Wipro is hiring for Big Data professional with minimum 5years experience in Big Data technologies. Immediate joiners will be preferred. About the Role : Knowledge Graph Specialist/Big Data Engineer- Design, build, and maintain scalable big data pipelines for processing and analyzing large datasets using Spark, Airflow, Bodo, Flume,...

  • Data Scientist

    2 weeks ago


    bareilly, India Truelancer.com Full time

    Job Title: Data Scientist Experience: 3 to 5 Years Job Overview: We are seeking a skilled and detail-oriented Data Scientist with 3 to 5 years of experience to join our team. The ideal candidate will possess expertise in Python and machine learning, with a strong foundation in linear optimization and forecasting techniques. You will be responsible for...


  • Bareilly, India The Data Family Full time

    Company DescriptionThe Data Family provides analytics and data visualization services to help clients transform data into actionable insights. We serve small to medium-sized businesses (SMBs) across various industries, focusing on those without an internal data team or in the process of building their data capabilities. Our services enable businesses to make...

  • Data Engineer

    1 month ago


    Bareilly, India Strand Life Sciences Full time

    About Strand Life Sciences:Strand is a 24-year-old spin-off from the Indian Institute of Science. We are a cutting-edge Genomics company with a global customer base. We build applications that use DNA sequencing to improve human health. In the process, we build algorithms, data pipelines, and visualizations to handle large amounts of sequence data. We are...

  • Head of Data Science

    4 weeks ago


    Bareilly, India Sigmoid Full time

    Sigmoid enables business transformation using data and analytics, leveraging real-time insights to make accurate and fast business decisions, by building modern data architectures using cloud and open source. Some of the world’s largest data producers engage with Sigmoid to solve complex business problems. Sigmoid brings deep expertise in data engineering,...


  • Bareilly, India Leading MNC Full time

    Looking for a Freelance Backend Data Engineer to join a team of rockstar developers. The candidate should have a minimum of 4 years. of experience .There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will...


  • Bareilly, India SIRO Clinpharm Pvt. Ltd. Full time

    Key Responsibilities:Program listings and mappingsCreate visualizationsHands on exposure in reviewing Clinical Data in JReviewAutomation of tasksConfigure data extraction and transformations in an individual contributor role across multiple data sources at the study level as defined by the Data Transfer Agreement and other specifications provided by Data...


  • Bareilly, India Applied Systems India Full time

    Experience - 7+yrsEducation - Diploma, BA, BSWhat You'll need:Strong organization skills and the ability to multitaskExcellent verbal and written communication skillsExperience in - Windows Server 2019/2022AzureGCPPowerShellTerraformVMWareWhat you'll do:Design and build cloud and on-premises infrastructureBuild, configure, deploy new software packagesCreate...

  • DevOps Lead

    4 weeks ago


    Bareilly, India SID Global Solutions Full time

    Please find the below JD for DevOps GCP Lead role.Must be able to Develop and maintain CI/CD pipelines using tools like Jenkins, GitLab CI, or CircleCI.Must be able to Implement Infrastructure as Code (IaC) using Terraform or Deployment Manager.Must be able to Configure and manage GCP services including Compute Engine, Kubernetes Engine, and Cloud...


  • Bareilly, India Flexton Inc. Full time

    Job Title: Sr Java developer with nosql and Cloud Duration - Fulltime/ContractSalary - 20 to 25 LPA fixed5+year expBack-end / Integration:1 Java Developer with Java and Springboot.Strong in DS/AlgoAny nosql database like Mongo, cassandara needed.Exp on cloud (Aws/Azure/Gcp) needed.Any SRE exp needed.Shishir


  • Bareilly, India Luxoft Full time

    Project Description:We are looking for an experienced senior Snowflake data engineer. The person should have proven hands-on experience on Azure ADF and Snowflake. The project goal is to design the data model, setup data ingestion using ADF and build the model in Snowflake, to make data available into a reporting layer. DBT is always an added advantage as...

  • Lead Backend Engineer

    4 weeks ago


    Bareilly, India Binaryveda Full time

    IntroductionAre you ready to take your backend expertise to the next level? Join us at Binaryveda, a dynamic product design and development studio in India with big aspirations to make a global impact. We are on a mission to create innovative, high-quality solutions that truly matter, and we’re looking for a passionate Lead Backend Engineer to help us get...

  • Solutions Manager

    1 week ago


    bareilly, India Infomatics - Complex Data, Simplified Full time

    This is a role for a Sales/Solution Manager at Infomatics. As a Sales manager, you will be responsible for driving revenue growth and building relationships with clients. You will oversee the sales process from lead generation to closing and collaborate with cross-functional teams to ensure client satisfaction. The Sales Manager must be able to communicate...


  • Bareilly, India CES Full time

    AI/Lead Data Scientist:CES is an information technology consulting and process outsourcing services company, which helps its customers with information technology services/solutions and streamlines their business process by leveraging our expertise and domain knowledge in various technologies such as Microsoft, Java, LAMP, Oracle, and SAP. CES delivers these...

  • Project Engineer

    1 week ago


    Bareilly, India Ultraviolette Automotive Full time

    We are committed to excellence and are looking for a dynamic and motivated Entry-Level Program Manager to join our team.About the Role: We are seeking an entry-level Program Manager with 2-4 years of experience to manage and coordinate projects related to mechanical components. The ideal candidate will have a strong foundation in project management...


  • Bareilly, India Sony Pictures Networks India Full time

    Sony Pictures Networks India is seeking smart, driven and experienced Product Analyst, Digital Business. The primary role of the incumbent is to be part of the product team and help drive the growth and success of the product.POSITION SPECIFICATIONEducation - Graduate degree in a relevant field such as Engineering, Statistics, Operational Research, Computer...


  • Bareilly, India Fiddler AI Full time

    Our PurposeAt Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. With the rise of the internet, trust in AI has been degraded by a plethora of issues like spam, fraudulent transactions, hate speech, and online abuse. Fiddler enables organizations to get...

  • Solution Engineer

    2 months ago


    Bareilly, India Quess Corp Limited Full time

    Hi We are Hiring,Roel : Solution EngineerExp : 4+ YearsLoc : Bangalore (Hebbal)Work Mode : Hybrid.JD:Key Responsibilities: Platform Administration: Manage the Power BI service including workspaces, data sources, and dataflows. User Management: Control user access and permissions, ensuring appropriate security measures are in place. Data Governance:...

  • Traffic Engineer

    4 weeks ago


    Bareilly, India Dar Full time

    Dar, the founding entity of the Sidara Group, is a global multidisciplinary consultancy specializing in engineering, architecture, planning, environmental services, project management, facilities management, and economics. Operating in 60 countries with a team of 20,500 professionals, Dar bridges people, places, and communities by providing innovative...