Big Data and Gcp

2 weeks ago

Bengaluru Karnataka, India Manage Captive Solutions Full time

**Who We Are**
Manage Captive Solutions (MCS) stands as the ultimate solution for effortless offshore hiring, precise payroll management, streamlined administration, and stringent compliances. We provide businesses distinctive solutions, making it easy to hire and onboard new team members. By removing the hurdles of setting up a local office, we enable businesses to focus on expanding their horizons.Our holistic service oversees the entire onboarding process, managing everything from local regulations to payroll intricacies and compliance matters. Additionally, our commitment to cutting-edge technology delivery further enhances their business operations.

**Job Title**: Big Data and GCP
**Experience Level**: 4-8 years
**Location**: Bangalore (On-site)
**Availability**: Immediate

Key Responsibilities:

- Design, develop, and maintain scalable data pipelines and ETL processes using GCP services such as Dataflow, Dataprep, and Composer.
- Implement data ingestion, transformation, and storage solutions using technologies like Hive, Spark, PySpark, and Python.
- Work closely with cross-functional teams to understand data requirements and translate them into technical solutions.
- Optimize and tune data pipelines for performance, reliability, and efficiency.
- Collaborate with data scientists and analysts to provide access to high-quality data and ensure data integrity.
- Monitor, troubleshoot, and resolve issues related to data processing and performance.
- Stay updated with emerging technologies and industry trends in big data and cloud computing.

Qualifications:

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 4 to 8 years of experience in big data engineering and cloud technologies, with a focus on GCP.
- Strong proficiency in programming languages such as Python and SQL.
- Hands-on experience with big data processing frameworks like Spark and Hive.
- Experience with GCP services including BigQuery, Pub/Sub, Dataflow, and Composer.
- Knowledge of CI/CD practices and tools for automating deployment and testing.
- Familiarity with database systems such as MySQL, NoSQL, and Google Cloud SQL.
- Experience with real-time data streaming technologies like Kafka is a plus.
- Excellent communication skills and ability to work effectively in a collaborative team environment.

**How to Apply**:
Manage Captive Solutions is an equal opportunity employer and encourages individuals from diverse backgrounds to apply.

**Job Types**: Full-time, Permanent

**Benefits**:

- Health insurance
- Provident Fund

Schedule:

- Day shift
- Monday to Friday

**Experience**:

- total work: 5 years (preferred)

Ability to Commute:

- Bangalore, Karnataka (required)

Ability to Relocate:

- Bangalore, Karnataka: Relocate before starting work (required)

Work Location: In person

**Speak with the employer**

+91 7895546435

  • Big Data and Gcp

    2 days ago

    Bengaluru, Karnataka, India Manage Captive Solutions Full time

    Who We AreManage Captive Solutions (MCS) stands as the ultimate solution for effortless offshore hiring, precise payroll management, streamlined administration, and stringent compliances. We provide businesses distinctive solutions, making it easy to hire and onboard new team members. By removing the hurdles of setting up a local office, we enable businesses...

  • Gcp Data Architect

    1 month ago

    Bengaluru, Karnataka, India Coforge Ltd. Full time

    **Position: GCP Data Architect** **Location: Gr. Noida, Bangalore, Hyderabad, Pune** **Duration: Full Time** **JOB DESCRIPTION**: **Designing Data Architecture**: Analyze data requirements and business needs to design high-level and detailed data architecture plans. Select appropriate data storage solutions like BigQuery, Cloud Storage, and Cloud SQL...

  • Senior GCP Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget :Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • Gcp Data Architect

    3 days ago

    Bengaluru, Karnataka, India Coforge Ltd. Full time

    **Position: GCP Architect** **Location: Bangalore OR Greater Noida** **Duration: Full time** **JOB DESCRIPTION**: - Good understanding of GA4 Model and Big Query linking for GA4 - Experience in Data form to create the database - Experienced using Bitbucket for versioning the SQL code created on Data form - Solid programming skills in SQL, Python,...

  • GCP Data Engineer

    2 months ago

    Bengaluru, India Coforge Full time

    Job DescriptionPosition: GCP Data EngineerLocation: BangaloreDuration: Full TimeMUST HAVE SKILLS:1: Scala2: Python3: GCP Cloud (Big Query, Big Table, Google Cloud Storage)4: ETL Pipelines and Data PipelinesRESPONSIBILITIES:Build data pipelines on cloud GCP Environment.Implement tasks for Automatic job Schedular for task/workflow orchestration.Extract data...

  • Senior GCP Big Data Engineer

    2 weeks ago

    Bengaluru, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • Senior GCP Big Data Engineer

    2 months ago

    Bengaluru, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • gcp data architect

    2 days ago

    Bengaluru, Karnataka, India Coforge Full time

    Job DescriptionPosition: GCP ArchitectLocation: Bangalore OR Greater NoidaDuration: Full timeJOB DESCRIPTION:Good understanding of GA4 Model and Big Query linking for GA4Experience in Data form to create the databaseExperienced using Bitbucket for versioning the SQL code created on Data formSolid programming skills in SQL, Python, PysparkExperience in Looker...

  • Big Data Architect

    7 days ago

    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • GCP Data Engineer

    2 months ago

    Bengaluru, India Coforge Full time

    Job Description Position: GCP Data Engineer Location: Bangalore Duration: Full Time MUST HAVE SKILLS: 1: Scala 2: Python 3: GCP Cloud (Big Query, Big Table, Google Cloud Storage) 4: ETL Pipelines and Data Pipelines RESPONSIBILITIES: Build data pipelines on cloud GCP Environment. Implement tasks for Automatic job...

  • GCP-Big-Query

    2 days ago

    Bengaluru, Karnataka, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManevaJobDescriptionJobTitle GCPBigQueryLocationBangaloreExperience7 15Years JobRequirements: 7 years total experience with Min 3 yearsExperience with Building Pipelines using GCPBigQuery. Min 23 Experience in working on LargeScale Data warehouses likeTeradata. Experience building and optimizing datawarehousing data pipelines (ELT and ETL)...

  • Gcp Architect

    2 months ago

    Bengaluru, Karnataka, India Impetus Technologies Full time

    10-15 years of experience in the role of implementation of high end software products. - Provides technical leadership in Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, HBase etc) and contributes to open source Big Data technologies. - Must have : Operating knowledge of cloud computing platforms (GCP, especially Big Query, Dataflow, Dataproc,...

  • gcp data architect

    2 days ago

    Bengaluru, Karnataka, India Coforge Full time

    Job Description Position: GCP Architect Location: Bangalore OR Greater Noida Duration: Full time JOB DESCRIPTION: Good understanding of GA4 Model and Big Query linking for GA4 Experience in Data form to create the database Experienced using Bitbucket for versioning the SQL code created on Data form Solid programming skills in SQL,...

  • GCP data engineer

    2 months ago

    Bengaluru, India Impetus Full time

    Qualifications:3.5-7 years of IT experience range is preferred.The candidate should have extensive production experience (2-3 Years) in GCP, Other cloud experience would be a strong bonus.Strong background in Data engineering 3-6 Years of exp in Big Data technologies including, Hadoop, NoSQL, Spark, Kafka etc.Exposure to enterprise application development is...

  • GCP-Big-Query

    3 weeks ago

    Bengaluru, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManeva!JobDescriptionJobTitle GCPBigQueryLocationBangaloreExperience7 15Years JobRequirements: 7 years total experience with Min 3 yearsExperience with Building Pipelines using GCPBigQuery. Min 23 Experience in working on LargeScale Data warehouses likeTeradata. Experience building and optimizing datawarehousing data pipelines (ELT and ETL)...

  • GCP-Big-Query

    1 week ago

    Bengaluru, India Maneva Consulting Pvt. Ltd Full time

    GreetingsFromManeva!JobDescriptionJobTitle GCPBigQueryLocationBangaloreExperience7 15Years JobRequirements: 7 years total experience with Min 3 yearsExperience with Building Pipelines using GCPBigQuery. Min 23 Experience in working on LargeScale Data warehouses likeTeradata. Experience building and optimizing datawarehousing data pipelines (ELT and ETL)...

  • Gcp Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Tech Mahindra Full time

    We are seeking a highly skilled GCP Data Engineer to join our team.The ideal candidate will have extensive experience with Google Cloud Platform (GCP) services, particularly Dataflow, Big Query, Pub/Sub, and related services.Additionally, the candidate should be proficient in provisioning infrastructure on GCP using Infrastructure as Code (Ia C) with...

  • Gcp Data Architect

    1 week ago

    Bengaluru, Karnataka, India Infogain Full time

    ROLES & RESPONSIBILITIES **Core Skills** - In-depth knowledge of Google Cloud Platform (GCP) data services such as BigQuery, Cloud Storage, and Dataflow. - Experience in designing and implementing scalable data solutions on GCP. - Proficiency in data modeling and database design on GCP. - Understanding of data governance and security practices on...

  • Gcp Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Impetus Full time

    Location: Bangalore/Gurgaon4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.G. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies – Hadoop, Sqoop, Hive...

  • GCP Data Engineer

    2 months ago

    Bengaluru, India Impetus Full time

    Location: Bangalore/Gurgaon4-7 years of IT experience range is preferred.Able to effectively use GCP managed services e.g. Dataproc, Dataflow, pub/sub, Cloud functions, Big Query, GCS - At least 4 of these Services.Good to have knowledge on Cloud Composer, Cloud SQL, Big Table, Cloud Function.Strong experience in Big Data technologies – Hadoop, Sqoop, Hive...