GCP Big Data Engineer

3 weeks ago

Chennai, India IntraEdge Full time

About the Role:

We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to build, deploy, and maintain scalable and reliable data pipelines for processing and analyzing large datasets.

Responsibilities:

  • Design, develop, and implement big data solutions using GCP services like BigQuery, Cloud Dataflow, Cloud Dataproc, and Cloud Storage.
  • Ingest, transform, and load (ETL) data from various sources into BigQuery for efficient data analysis.
  • Looking for a Data Engineer with strong expertise in Python and Big Data concepts to build, optimize, and scale data processing pipelines and solutions.
  • Develop and automate data pipelines using tools like Cloud Dataflow for large-scale data processing.
  • Manage and optimize big data infrastructure on GCP to ensure scalability, performance, and cost-effectiveness.
  • Configure and implement security best practices for big data storage and processing in GCP.
  • Monitor and troubleshoot big data pipelines and identify areas for improvement.
  • Work collaboratively with data scientists, analysts, and other engineers to translate data needs into technical solutions.
  • Stay up-to-date with the latest advancements in big data technologies and GCP services.

Qualifications:

  • 5+ years of experience in big data engineering or a related role.
  • Proven experience in designing and developing big data solutions on the cloud (preferably GCP).
  • Strong understanding of big data concepts (data lakes, data warehouses, distributed processing)
  • Expertise in GCP services for big data processing (BigQuery, Cloud Dataflow, Cloud Dataproc).
  • Experience with scripting languages like Python for data manipulation and automation.
  • Experience with cloud storage solutions (e.g., Cloud Storage) a plus.
  • Experience with data warehousing concepts and data modeling techniques (a plus).
  • Excellent analytical and problem-solving skills.
  • Strong communication and collaboration skills.
  • Ability to work independently and as part of a team.

  • GCP Big Data Engineer

    2 weeks ago

    Chennai, India IntraEdge Full time

    About the Role: We are seeking a highly motivated and experienced Big Data Engineer to join our growing team in Chennai, Bangalore, or Gurgaon. In this role, you will play a key part in designing, developing, and managing our big data infrastructure on Google Cloud Platform (GCP). You will leverage your expertise in big data technologies and GCP services to...

  • GCP Data Engineer

    22 hours ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably...

  • Gcp Big Data Architect

    3 months ago

    Chennai, Tamil Nadu, India Tiger Analytics Full time

    -As an Architect, you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in GCP. - GCP experts with strong experience in working with modern data...

  • GCP Data Engineer

    2 days ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP....

  • GCP Data Engineer

    16 hours ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably GCP....

  • GCP Data Engineer

    2 days ago

    chennai, India Tata Consultancy Services Full time

    Greetings from TCS TCS presents an excellent opportunity for GCP Data Engineer Relevant Experience (Yrs) :5-7 yrs Role: GCP Data Engineer Location: Chennai Desired Competencies (Technical/Behavioral Competency) Must-Have 5+ years of strong experience in delivering Big Data solutions. Experience in developing and deploying big data pipelines in Cloud...

  • GCP Big Data Engineer for our Client American Express

    3 weeks ago

    Chennai, India GIT Infosys Full time

    We need a proficient and seasoned Big Data Engineer with GCP cloud expertise and Lumi tool migration for our client American Express, Chennai. Someone with at least 5+ years of experience and who can join in 2-3 weeks. ResponsibilitiesTools & Technologies: Big Data (Hadoop, HBase, Hive, etc.), GCP cloud expertise, Lumi tool migrationQualificationsBachelors...

  • GCP Big Data Engineer for our Client American Express

    3 weeks ago

    Chennai, India GIT Infosys Full time

    We need a proficient and seasoned Big Data Engineer with GCP cloud expertise and Lumi tool migration for our client American Express, Chennai. Someone with at least 5+ years of experience and who can join in 2-3 weeks. ResponsibilitiesTools & Technologies: Big Data (Hadoop, HBase, Hive, etc.), GCP cloud expertise, Lumi tool migrationQualificationsBachelors...

  • GCP Data Engineer

    4 weeks ago

    Chennai, India Xebia Full time

    Establish scalable, efficient, automated processes for data analyses, model development, validation and implementationWork closely with data scientists and analysts to create and deploy new featuresWrite efficient and well-organized software to ship products in an iterative, continual release environmentMonitor and plan out core infrastructure...

  • GCP Data Engineer

    1 week ago

    Chennai, India Technogen, Inc. Full time

    If interested, please drop your resume to swarnalatha.m@technogenindia.comRole- Sr Engr Cslt-Data EngineeringLocation-ChennaiExp-6 to 8.5 yearsPrimary: SQL, GCP (BigQuery, Composer, Data Flow), Big Data (Spark/ Kafka/ Hive/ Pyspark)Secondary: Teradata (BTEQ, Performance Tuning), ESPx, Python, DevOps What we're looking for...You're curious about new...

  • GCP Data Engineer

    23 hours ago

    Chennai, India Tata Consultancy Services Full time

    Greetings from TCSTCS presents an excellent opportunity for GCP Data EngineerRelevant Experience (Yrs) :5-7 yrsRole: GCP Data EngineerLocation: ChennaiDesired Competencies (Technical/Behavioral Competency)Must-Have5+ years of strong experience in delivering Big Data solutions.Experience in developing and deploying big data pipelines in Cloud preferably...

  • GCP Data Engineer

    1 week ago

    chennai, India Technogen, Inc. Full time

    If interested, please drop your resume to Sr Engr Cslt-Data EngineeringLocation-ChennaiExp-6 to 8.5 yearsPrimary: SQL, GCP (BigQuery, Composer, Data Flow), Big Data (Spark/ Kafka/ Hive/ Pyspark)Secondary: Teradata (BTEQ, Performance Tuning), ESPx, Python, DevOpsWhat we're looking for...You're curious about new technologies and the game-changing...

  • GCP Data Engineer

    4 weeks ago

    Chennai, India Xebia Full time

    Establish scalable, efficient, automated processes for data analyses, model development, validation and implementationWork closely with data scientists and analysts to create and deploy new featuresWrite efficient and well-organized software to ship products in an iterative, continual release environmentMonitor and plan out core infrastructure...

  • GCP Data Engineer

    4 weeks ago

    Chennai, India Xebia Full time

    Establish scalable, efficient, automated processes for data analyses, model development, validation and implementation Work closely with data scientists and analysts to create and deploy new features Write efficient and well-organized software to ship products in an iterative, continual release environment Monitor and plan out core infrastructure...

  • Senior Data Engineer

    3 days ago

    Chennai, India Trinity Technology solutions Full time

    We're seeking a highly skilled and experienced Senior Data Engineer to join our team! You will play a pivotal role in designing, developing, and deploying robust data pipelines and data warehouse solutions leveraging Google Cloud Platform (GCP). You will leverage your expertise in big data technologies like Hadoop, Spark, and Airflow to build scalable...

  • GCP Architect

    2 weeks ago

    Chennai, India Tech Mahindra Full time

    Hi All,Greetings from Tech Mahindra.We are hiringGCP Architects for Chennai Location . JD is below. If you are interested kindly apply with your updated profileGCP Certification is mandatory (Either GCP Data Engineer or GCP Cloud Architect)• 12+ years of experience in Architecting Data projects and knowledge of multiple ETL tools (like Informatica, Talend,...

  • GCP Architect

    2 weeks ago

    Chennai, India Tech Mahindra Full time

    Hi All, Greetings from Tech Mahindra. We are hiring GCP Architects for Chennai Location . JD is below. If you are interested kindly apply with your updated profile GCP Certification is mandatory (Either GCP Data Engineer or GCP Cloud Architect) • 12+ years of experience in Architecting Data projects and knowledge of multiple ETL tools (like Informatica,...

  • GCP Architect

    3 weeks ago

    Chennai, India Tech Mahindra Full time

    Hi All,Greetings from Tech Mahindra.We are hiring GCP Architects for Chennai Location. JD is below. If you are interested kindly apply with your updated profile GCP Certification is mandatory (Either GCP Data Engineer or GCP Cloud Architect)• 12+ years of experience in Architecting Data projects and knowledge of multiple ETL tools (like Informatica,...

  • Data Engineer IV

    1 month ago

    Chennai, India Sadup Softech Full time

    Must have skills :- Minimum of 5-7 years of experience in software development, with a focus on Java and infrastructure tools.- Min 6+ years of experience as a Data Engineer.- Good Experience in handling Big Data Spark, Hive SQL, BigQuery, SQL.- Candidate worked on cloud platforms and GCP would be an added advantage.- Good understanding of Hadoop based...

  • Big Data Architect

    3 months ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

    **Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...