GCP Big Data Engineer

6 days ago


Lucknow, India People Prime Worldwide Full time

About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful results. We combine logic, creativity and curiosity to build, solve, and create. Every day, we help clients engage with new technology paradigms, creatively building solutions that solve their most pressing business challenges and move them to the forefront of their industry.

Job Title : GCP Big Data Engineer

Key Skills : PySpark , Airflow , SQL , GCP , ETL, Python, Big Quarry

Job Locations : Gurugram ,Bangalore

Experience : 6-10 years

Education Qualification : Any Degree Graduation

Work Mode : Hybird

Employment Type : Contract

Notice Period : Immediate - 10 Days

Job description:


Job Summary

We are seeking a seasoned GCP Data Analytics professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions

Job Description

Design develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support largescale data analytics Utilize the Big Data Hadoop ecosystem to manage and process vast datasets efficiently Collaborate with crossfunctional teams to gather requirements and deliver reliable data solutions Ensure data quality consistency and integrity across multiple data sources Monitor and troubleshoot data workflows to maintain high system availability and performance Stay updated with emerging trends and best practices in GCP data analytics and big data technologies

Roles and Responsibilities

Implement and manage ETL processes leveraging GCP services such as BigQuery Dataflow and Airflow Develop scalable maintainable and reusable data pipelines to support business intelligence and analytics needs Optimize SQL queries and data models for performance and cost efficiency in BigQuery Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities Automate workflow orchestration using Apache Airflow for seamless data operations Collaborate with data engineers analysts and stakeholders to ensure alignment of data solutions with organizational goals Participate in code reviews testing and deployment activities adhering to best practices Mentor junior team members and contribute to continuous improvement initiatives within the data engineering team



Skills


Mandatory Skills : GCP Storage,GCP BigQuery,GCP DataProc,GCP Cloud Composer,GCP DMS,Apache airflow,Java,Python,Scala,GCP Datastream,Google Analytics Hub,GCP Workflows,GCP Dataform,GCP Datafusion,GCP Pub/Sub,ANSI-SQL,GCP Dataflow,GCP Data Flow,GCP Cloud Pub/Sub,Big Data Hadoop Ecosystem


  • GCP Looker

    2 weeks ago


    Lucknow, Uttar Pradesh, India Tata Consultancy Services Full time

    Role: GCP LookerRequired Technical Skill Set: GCP LookerDesired Experience Range: 6-10 yrsLocation of Requirement: Chennai, Gandhinagar, BangaloreNotice period: Immediate joiner onlyJob Description:Experience: Associate should have 4+ years of IT experience with good exposure into diagnosis and troubleshooting the complex issues.Technologies: Tableau, Power...


  • Lucknow, India Extreme Networks Full time

    Over 50,000 customers globally trust our end-to-end, cloud-driven networking solutions. They rely on our top-rated services and support to accelerate their digital transformation efforts and deliver unprecedented progress. With double-digit growth year over year, no provider is better positioned to deliver scalable outcomes than Extreme.Inclusion is one of...

  • Data Engineer

    2 weeks ago


    Lucknow, India Carnation Infotech Full time

    Title Data Engineer 100% Work from Home / Remote Work Timings - 1:30 PM – 10:30 PM Fulltime Role Job Summary As a Data Engineer , you will be responsible for designing, building, and maintaining the infrastructure and tools that enable the organization to collect, store, and analyze large volumes of data. You will work closely with data scientists,...

  • Azure Data Engineer

    3 weeks ago


    Lucknow, Uttar Pradesh, India techolution Full time

    We are seeking a skilled Azure Data Engineer with hands-on experience in modern data engineering tools and platforms within the Azure ecosystem . The ideal candidate will have a strong foundation in data integration, transformation, and migration , along with a passion for working on complex data migration projects . Job Title: Sr. Azure Data Engineer ...


  • Lucknow, India JRD Systems Full time

    The Role: Backend and Data Pipeline Engineer:The Team: We are investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new customer needs and are highly visible and strategic within the organization. Do you...

  • Senior Data Engineer

    4 weeks ago


    Lucknow, Uttar Pradesh, India EXL Full time

    About the RoleWe are seeking a highly skilled Data Engineer with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower analytics and data...

  • Data Engineer

    1 week ago


    Lucknow, India RevX Full time

    Data Engineer About RevXRevX helps app businesses acquire and reengage users via programmatic to retain, monetize, and accelerate revenue. We're all about taking your app businesses to a new growth level. We rely on data science, innovative technology, and AI, and a skilled team, to create and deliver seamless ad experiences to delight your app users....


  • Lucknow, Uttar Pradesh, India NTek Software Solutions Full time

    Job Title: Machine Learning EngineerLocation: Remote (India)Experience: 6–8 YearsEmployment Type: Full-timeNotice Period: Immediate to 15 DaysRole Overview:We are seeking an experienced Machine Learning Engineer to join our advanced analytics and AI team. The ideal candidate will design, develop, and deploy ML models at scale, working with large datasets...

  • Senior ai engineer

    3 days ago


    Lucknow, India Chetty Technologies Full time

    Company DescriptionChetty Technologies is a specialized Technology Company providing high-end consulting services in the Banking & Finance, Telecom, Healthcare, and Hospitality domains. With offices in the US and India, we offer solutions in Application Development, AI & Machine Learning, Big Data & Analytics, Business Intelligence, Robotic Process...

  • Data Scientist

    3 weeks ago


    Lucknow, Uttar Pradesh, India Tezo Full time

    Tezo is a new generation Digital & AI solutions provider, with a history of creating remarkable outcomes for our customers. We bring exceptional experiences using cutting-edge analytics, data proficiency, technology, and digital excellence.Role: Data Scientist Experience: 3-4 YearsLocation: Hyderabad (Hybrid)Tezo is seeking a highly motivated Data Scientist...