Data Engineer for Scalable GCP Infrastructure

4 days ago

Bengaluru, Karnataka, India Aditya Consulting Full time

Job Summary

We are seeking a highly skilled and experienced Cloud Data Engineer to join Aditya Consulting. The ideal candidate will have a strong background in data engineering with a focus on Google Cloud Platform (GCP) services.

About the Role

You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure on GCP, ensuring data is accessible, reliable, and available for business use.

Main Responsibilities

  • Data Pipeline Development: Design, develop, and maintain data pipelines using GCP services such as Dataflow, Dataproc, BigQuery, and Cloud Storage.
  • Data Integration: Work on integrating data from various sources (structured, semi-structured, and unstructured) into GCP environments.
  • Data Modeling: Develop and maintain efficient data models in BigQuery to support analytics and reporting needs.
  • Data Warehousing: Implement data warehousing solutions on GCP, optimizing performance and scalability.
  • ETL/ELT Processes: Build and manage ETL/ELT processes using tools like Apache Airflow, Data Fusion, and Python.
  • Data Quality & Governance: Implement data quality checks, data lineage, and data governance best practices to ensure high data integrity.
  • Automation: Automate data pipelines and workflows to reduce manual effort and improve efficiency.
  • Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
  • Optimization: Continuously monitor and optimize the performance of data pipelines and queries for cost and efficiency.
  • Security: Ensure data security and compliance with industry standards and best practices.

Requirements

  • Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
  • Experience: 5+ years of experience in data engineering, with at least 2 years working with GCP.
  • Technical Skills:
    • Proficiency in GCP services: BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Cloud Functions.
    • Strong programming skills in Python, SQL, Pyspark, and familiarity with Java/Scala.
    • Experience with orchestration tools like Apache Airflow.
    • Knowledge of ETL/ELT processes and tools.
    • Experience with data modeling and designing data warehouses in BigQuery.
    • Familiarity with CI/CD pipelines and version control systems like Git.
    • Understanding of data governance, security, and compliance.
  • Soft Skills:
    • Excellent problem-solving and analytical skills.
    • Strong communication and collaboration abilities.
    • Ability to work in a fast-paced environment and manage multiple priorities.

Preferred Qualifications

  • Certifications: GCP Professional Data Engineer or GCP Professional Cloud Architect certification.
  • Domain Knowledge: Experience in the finance, e-commerce, healthcare domain is a plus.

Salary Range

$120,000 - $180,000 per year.

  • Data Engineer for Scalable Data Infrastructure

    1 month ago

    Bengaluru, Karnataka, India Aditya Consulting Full time

    Job OverviewWe are seeking a highly skilled and experienced Cloud Data Engineer to join Aditya Consulting's dynamic team. The ideal candidate will have a strong background in data engineering with a focus on Google Cloud Platform (GCP) services.About the RoleThe successful candidate will be responsible for designing, building, and maintaining scalable data...

  • GCP Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    Job Description:We are seeking an experienced GCP Data Engineer to join our team at Tech Mahindra. As a key member of our cloud infrastructure team, you will be responsible for designing, developing, and maintaining data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub.Key Responsibilities:Design and develop scalable data pipelines using...

  • Cloud Engineer Leader for GCP Infrastructure

    3 weeks ago

    Bengaluru, Karnataka, India Palo Alto Networks Full time

    About the RolePalo Alto Networks is a global cybersecurity leader, dedicated to protecting the digital age by preventing successful cyberattacks. We're seeking an experienced Cloud Engineer Leader to join our Cortex XDR DevOps group in India.Job DescriptionThe successful candidate will be responsible for leading our team of SRE/DevOps engineers in operating...

  • Senior Infrastructure Engineer for Scalable Data Platforms

    2 weeks ago

    Bengaluru, Karnataka, India Groww Full time

    About GrowwWe are a dedicated team focused on making financial services accessible to every Indian through a cutting-edge, multi-product platform. Every day, we help millions of customers take control of their financial journey.Our team is driven by customer-centricity and a passion to defy conventions and create something extraordinary.We believe that every...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Gloify Full time

    About GloifyGloify is a fast-growing technology company that empowers businesses to thrive in the digital age. We're looking for talented professionals like you to join our team and contribute to our mission.Job SummaryWe are seeking an experienced Data Engineer to design, build, and maintain scalable data infrastructure. The ideal candidate should have...

  • GCP Data Engineer

    1 month ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    Job DescriptionA talented GCP Data Engineer is required to design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. The ideal candidate will have a strong proficiency in GCP services and hands-on experience with Terraform for provisioning and managing GCP infrastructure.Responsibilities• Design, develop, and...

  • Cloud Infrastructure Engineer with GCP Expertise

    15 hours ago

    Bengaluru, Karnataka, India Molecular Connections Full time

    About Molecular Connections: Pioneering AI-ML Driven Content SolutionsWe are a leading AI-ML driven content solutions company from India, working with global publishing leaders for over 20+ years. Our core offerings include digital transformation of scientific content and AI/ML based publishing work-flows.Job Title: Cloud Infrastructure Engineer with GCP...

  • Cloud Infrastructure Architect for Scalable Systems

    1 month ago

    Bengaluru, Karnataka, India NoBroker Full time

    About UsNoBroker is the world's largest brokerage-free real estate marketplace, dedicated to transforming the real estate experience with cutting-edge products. Our comprehensive ecosystem includes community management, property management, and a range of services like legal support, rental agreements, packers & movers, home loans, rent payments, and...

  • Cloud Engineer for Scalable Infrastructure Development

    15 hours ago

    Bengaluru, Karnataka, India Molecular Connections Full time

    About Molecular ConnectionsMolecular Connections is a pioneering AI-ML driven content solutions company from India, renowned for over 20+ years of collaboration with global publishing leaders across the full spectrum of STEM domains. Our core offerings include digital transformation of scientific content and AI/ML based publishing work-flows with...

  • Data Engineering Expert for Scalable Data Infrastructure

    1 month ago

    Bengaluru, Karnataka, India TMRW House of Brands Full time

    About TMRW House of BrandsWe're a dynamic company pushing the boundaries in the data engineering space. As a Data Engineer at TMRW House of Brands, you'll play a pivotal role in building and maintaining our robust data infrastructure.Salary RangeThe estimated salary for this position is between $120,000 to $180,000 per year, depending on your level of...

  • GCP Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Torry Harris Business Solutions Full time

    Torry Harris Business Solutions is looking for a skilled GCP Engineer - Data Solutions to work on our cloud-based data projects. As a key member of our team, you will design and implement data engineering solutions using GCP services.We are offering a salary of $145,000 per annum, along with opportunities for career advancement and professional growth.Job...

  • Data Infrastructure Specialist

    3 weeks ago

    Bengaluru, Karnataka, India Infometry Full time

    Company Overview:Infometry is a leading provider of innovative data solutions. We are committed to delivering high-quality services to our clients and believe in fostering a collaborative and dynamic work environment. Our company culture values innovation, creativity, and teamwork, making us an attractive workplace for professionals looking to grow their...

  • Software Engineering Leader for Scalable Data Infrastructure

    2 weeks ago

    Bengaluru, Karnataka, India LinkedIn Full time

    OverviewAt LinkedIn, we're dedicated to helping professionals achieve their career goals. Our team is passionate about building innovative products that transform lives through technology. As a Software Engineering Leader for Scalable Data Infrastructure, you'll play a key role in driving our global charter around data movement, ensuring seamless and...

  • Scalable Systems Engineer

    3 weeks ago

    Bengaluru, Karnataka, India XHire Full time

    Job DescriptionXHire is looking for a highly skilled Scalable Systems Engineer to join our team. As a Scalable Systems Engineer, you will be responsible for designing and implementing scalable infrastructure for delivering and running web, mobile, and big data applications on cloud platforms.Your Key ResponsibilitiesDesign and implement scalable...

  • Data Engineer: Scalable Pipeline Expert

    3 weeks ago

    Bengaluru, Karnataka, India Idexcel Technologies Full time

    Job Title: Data EngineerWe are seeking an experienced Data Engineer with expertise in designing, developing and managing scalable data pipelines and streaming solutions.$120,000 - $180,000 per annumMandatory Skills:Apache Spark: Strong expertise in Spark-based data processing.Python: Proficiency in developing and maintaining data pipelines.Databases & SQL:...

  • Cloud Computing Expert with Scalable Infrastructure

    5 days ago

    Bengaluru, Karnataka, India BT Group Full time

    We are seeking a skilled Data Architect to join our team at BT Group.About the RoleThis is a highly competitive position that requires a strong understanding of Cloud Computing patterns, workflows, and services. As a key member of our infrastructure team, you will be responsible for designing and implementing scalable data solutions on Google Cloud Platform...

  • Data Engineering Leader for Scalable Data Solutions

    4 weeks ago

    Bengaluru, Karnataka, India Observe Full time

    About Observe.AIWe are the fastest way to boost contact center performance with live conversation intelligence. Our AI engine uncovers insights from 100% of customer interactions and maximizes frontline team performance through coaching and end-to-end workflow automation.With Observe.AI, companies can act faster with real-time insights and guidance to...

  • Cloud Infrastructure Engineer

    5 days ago

    Bengaluru, Karnataka, India ThoughtFocus Full time

    About the RoleWe are seeking an experienced Cloud Infrastructure Engineer to join our team at ThoughtFocus. As a key member of our engineering team, you will design, deploy, and manage cloud infrastructure on Google Cloud Platform (GCP).

  • Data Engineer for Scalable Enterprise Systems

    5 days ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    About Hevo DataWe empower businesses to drive growth by consolidating data from multiple sources, enabling faster analytics and informed decision making.Mission and VisionOur mission is to build technology that's simple to adopt and easy to access. We aim to unlock the potential of data for everyone.A Day in the Life of a Data Engineer at HevoYou'll work on...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India QWINIX TECHNOLOGIES PRIVATE LIMITED66degrees Full time

    About QWINIX TECHNOLOGIES PRIVATE LIMITED / 66degreesWe are a leading consulting and professional services company specializing in developing AI-focused, data-led solutions leveraging the latest advancements in cloud technology. Our unmatched engineering capabilities and vast industry experience enable us to help the world's leading brands transform their...