Cloudsufi - GCP Data Engineer - SQL/BigQuery

2 months ago


india Cloudsufi India Private Limited Full time

About Us :

CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for the Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting-edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.

Our Values :

We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners, and the community.

Equal Opportunity Statement

CLOUDSUFI is an equal-opportunity employer . We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation and national origin status. We are dedicated to providing equal opportunities in employment, advancement, and all other areas of our workplace.

What we are looking for :

CLOUDSUFI is seeking a GCP Data Engineer - Dataform. In this role, you will spearhead the development and management of data pipelines and analytics solutions on GCP, ensuring they meet and surpass customer expectations. Your responsibilities will encompass overseeing the entire data engineering process, from quality planning to defect management, while leading a talented team of data engineers. Your expertise will be crucial in defining and implementing testing strategies, driving process improvements, and mitigating risks to ensure the reliability, accuracy, and performance of data processes. With your strong communication skills, you will effectively report project status, quality metrics, and issues to stakeholders, ensuring alignment and transparency. If you're passionate about leveraging GCP for innovative data solutions and thrive in a dynamic environment, join us and make a significant impact on transforming data into actionable insights at CLOUDSUFI.

Responsibilities :

  • Oversee and manage the entire data engineering process within a project on Google Cloud Platform (GCP).
  • Play a crucial role in ensuring that the final data solution meets or exceeds customer expectations.
  • Develop and implement quality planning strategies for data pipelines and analytics solutions.
  • Lead and manage a team of data engineers, ensuring efficient collaboration and high-quality output.
  • Define and implement testing strategies for data pipelines and analytics solutions.
  • Design and execute tests to ensure the reliability, accuracy, and performance of data processes.
  • Manage defects and issues in data pipelines, ensuring timely resolution and minimal impact on data integrity.
  • Drive process improvements in data engineering workflows to enhance efficiency and quality.
  • Identify and mitigate risks related to data engineering processes and solutions.
  • Generate reports and effectively communicate project status, quality metrics, and issues to Experience :

    Education :

    - Bachelor's degree or higher in Computer Science, Information Technology, Data Science, Engineering, or a related field.

    - Advanced degrees (Master's, PhD) can be advantageous but are not always necessary.

    Experience :

    - Previous experience as a data engineer or a related role is typically required, preferably within a cloud environment.

    - Hands-on experience with implementing data solutions using GCP services.

    Skills :
    • Bachelor's degree or higher in Computer Science, Information Technology, Data Science, Engineering, or a related field.
    • Proficiency in Google Cloud Platform (GCP) services, particularly those related to data engineering such as BigQuery, Dataflow, Cloud Storage, Cloud Pub/Sub, and Data Catalog.
    • Strong understanding of SQL for data manipulation and querying in BigQuery.
    • Experience with data modeling concepts and techniques.
    • Familiarity with version control systems like Git.
    • Knowledge of Dataform or other data orchestration and modeling tools is highly desirable.
    • Proficiency in programming languages commonly used in data engineering such as Python, Java, or Scala.
    • Experience with scripting languages like Bash for automation tasks.
    • Understanding of software engineering best practices, including code optimization, testing, and debugging.
    • Solid understanding of data warehousing concepts and methodologies.
    • Experience in designing, building, and optimizing ETL (Extract, Transform, Load) pipelines.
    • Knowledge of data governance and compliance standards.
    • Ability to work with structured and unstructured data formats.
    • Hands-on experience with implementing data solutions using GCP services.
    • Experience in developing and maintaining scalable and reliable data pipelines.
    • Familiarity with agile development methodologies and practices.
    • Strong problem-solving skills and the ability to troubleshoot complex data engineering issues.
    • Strong communication skills with the ability to collaborate effectively with cross-functional teams including data scientists, analysts, and business stakeholders.
    • Adaptability and willingness to learn new technologies and methodologies.
    • Attention to detail and a commitment to producing high-quality work.
    • Project management skills to effectively prioritize tasks and meet deadlines.
    Behavioral Competencies :
    • Must have worked with US/Europe based clients in onsite/offshore delivery model,
    • Should have very good verbal and written communication, technical articulation, listening and presentation skills
    • Should have proven analytical and problem-solving skills
    • Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills
    • Should be a quick learner, self-starter, go-getter and team player
    • Should have experience of working under stringent deadlines in a Matrix organization structure
    • Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations

    (ref:hirist.tech)


  • Anywhere in India/Multiple Locations, IN Cloudsufi India Private Limited Full time

    About Us :CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for the Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting-edge infrastructure and cloud services. We partner...


  • Anywhere in India/Multiple Locations Cloudsufi India Private Limited Full time

    About Us : CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for the Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting-edge infrastructure and cloud services. We...


  • Anywhere in India/Multiple Locations Cloudsufi India Private Limited Full time

    About Us : CLOUDSUFI is a Silicon Valley-based specialist Data Engineering & Cloud Technologies player with top-tier clients, favourable revenue mix, strong financial performance, and robust management. We pride ourselves in helping in the Data Discovery, Insights and Monetization for organizations. We offer quality of work, opportunities to learn new...

  • GCP Data Engineer

    1 month ago


    india Awign Expert Full time

    Job Description Job Title: GCP Data Engineer Overview:- Design, build, and maintain scalable data pipelines and workflowsusing Apache Airflow on Google Cloud Platform (GCP).- Develop and optimize ETL processes to extract, transform, and loaddata into BigQuery for analysis and reporting purposes.- Collaborate with cross-functional teams to gather...

  • GCP Data Engineer

    4 days ago


    india TekWissen India Full time

    Role: GCP Data Engineer Location: Chennai, India Experience: 4+ years Notice Period: Immediate to 15 days joiners Position Description: We are looking for an experienced data engineer to join our growing software engineering product team responsible for supporting finished vehicle logistics at Client Motor Company. As a team member of this product team...

  • GCP Data Engineer

    1 week ago


    india LTIMindtree Full time

    Job Title: GCP Sr. Data Engineer Experience: 5-12 years Education: Bachelor of engineering in any discipline/equivalent Location: Bangalore, Chennai, Mumbai, Pune, Kolkata, Hyderabad, Delhi Desired Candidate Profile Job Description: Overall, more than 5+ Yrs of experience in Data projects. Good Knowledge of GCP Bigquery, SQL, Python, dataflow skills....

  • GCP Data Engineer

    2 weeks ago


    india Tech Mahindra Full time

    Tech Mahindra hiring GCP Data Engineers for all across India Notice- Immediate/ Early joiners only** Experience- 4+ years Must have skills: Linux, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python Send CVs to if eligible.


  • Anywhere in India/Multiple Locations/Noida Cloudsufi India Private Limited Full time

    About Us : CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner...

  • GCP Data Engineer

    1 month ago


    india EXL Full time

    Hi, Please Find the JD Below Hands-on experience in GCP cloud data implementation suite like Cloud Storage, Dataflow/Apache Beam, Dataproc, PubSub, BigQuery & Airflow/Composer. Experience with creating streaming & batch jobs using Dataflow/Apache Beam and monitoring the Jobs using GCP Cloud Logging. Extensive experience working with SQL (nested data) &...


  • Anywhere in India/Multiple Locations Cloudsufi India Private Limited Full time

    Role : NetSuite Techno FunctionalAbout Us : CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure...


  • Anywhere in India/Multiple Locations, IN Cloudsufi India Private Limited Full time

    Role : NetSuite Techno FunctionalAbout Us :CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure...

  • Data Engineer

    2 days ago


    india Mindverse Consulting Services Full time

    Job Description For our Client we are looking for Data Engineer (GCP) ✔️Responsibilities: Working alongside Platform Engineers to assess and choose suitable technologies and tools for the projectR&D, maintenance, and monitoring of the platform's componentsImplementing intricate data intake proceduresConstructing efficient data modelsImplementing and...

  • GCP engineer

    14 hours ago


    india Tekgence Inc Full time

    Role : SME - Sr. Developer GCP Exp : 6 to 11 Yrs Location : PAN India NP : Immediate to 30 Days Skills Linux- mandatory, SQL, GCP BigQuery, CloudRun, Cloud Functions, GC Storage, Python

  • GCP Data Engineer

    4 weeks ago


    india Persistent Systems Full time

    About Position: As a GCP Data Engineer with strong experience in Python, Google Cloud and Bigquery Role: GCP Data Engineer Location: Mumbai Experience: 4-8 years Job Type: Full Time Employment What You'll Do: Establish data model design based on business requirements. Should be hands on. Develop end to end streaming and batch data analytics pipelines....

  • Data Engineer

    5 days ago


    india Stebr, Inc Full time

    Company Overview: Stebr, Inc is a leading software development company committed to delivering innovative solutions that drive business success. We are seeking a skilled Google Cloud Data Engineer to join our dynamic team and help us harness the power of Google Cloud Platform (GCP) to drive our strategic initiatives. Responsibilities: Design, develop,...

  • GCP Architect

    1 week ago


    india LTIMindtree Full time

    "Primary Skills GCP Data Architecture and designing streaming Batch pipelines Implementing Big Data solutions leveraging GCP cloud data technologies with extensive experience in ingestion processing and transformation Proficient in Python PySpark relational and NoSQL databases and GCP data technologies such BigQuery Dataproc Dataflow Data Fusion Cloud...

  • GCP Data Engineer

    14 hours ago


    india EXL Full time

    Position – GCP Data Engineer – Senior Work Location – Hybrid – all EXL locations. Will involve relocation for selected outstation candidates. Experience - 5 to 8 Years Must Have: 5+ years of proven experience in Big Data Engineering . Mandatory Technical Proficiency - Hands-on experience with Python , PySpark , Google Cloud Full Stack ,...

  • Senior Data Engineer

    4 weeks ago


    india Velotio Technologies Full time

    At Velotio, we are embracing a remote-friendly work culture where everyone has the flexibility to either work remotely or from our office in Pune. Join us and work from wherever you feel most productive!About Velotio: Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to...

  • Data Engineer

    2 months ago


    india Change Leaders Full time

    Primary Skill - GCP + Python + SQLORGCP + Java + SQL NP - Immediate to 35 Days maxJob Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...

  • GCP Data Engineer

    1 week ago


    india Tech Mahindra Full time

    GCP Data Engineer – 6 years of experience in GCP and Big Query, Cloud Storage Strong python programming experience in using Google Cloud python client libraries Strong SQL and data analysis skills Proficient ETL/ELT experience in workflows, data modelling and data pipelines