Cloudsufi - GCP Data Engineer - SQL/BigQuery

3 weeks ago

Anywhere in IndiaMultiple Locations, IN Cloudsufi India Private Limited Full time

About Us :

CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for the Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting-edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.

Our Values :

We are a passionate and empathetic team that prioritizes human values. Our purpose is to elevate the quality of lives for our family, customers, partners, and the community.

Equal Opportunity Statement

CLOUDSUFI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified candidates receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation and national origin status. We are dedicated to providing equal opportunities in employment, advancement, and all other areas of our workplace.

What we are looking for :

CLOUDSUFI is seeking a GCP Data Engineer - Dataform. In this role, you will spearhead the development and management of data pipelines and analytics solutions on GCP, ensuring they meet and surpass customer expectations. Your responsibilities will encompass overseeing the entire data engineering process, from quality planning to defect management, while leading a talented team of data engineers. Your expertise will be crucial in defining and implementing testing strategies, driving process improvements, and mitigating risks to ensure the reliability, accuracy, and performance of data processes. With your strong communication skills, you will effectively report project status, quality metrics, and issues to stakeholders, ensuring alignment and transparency. If you're passionate about leveraging GCP for innovative data solutions and thrive in a dynamic environment, join us and make a significant impact on transforming data into actionable insights at CLOUDSUFI.

Responsibilities :

  • Oversee and manage the entire data engineering process within a project on Google Cloud Platform (GCP).
  • Play a crucial role in ensuring that the final data solution meets or exceeds customer expectations.
  • Develop and implement quality planning strategies for data pipelines and analytics solutions.
  • Lead and manage a team of data engineers, ensuring efficient collaboration and high-quality output.
  • Define and implement testing strategies for data pipelines and analytics solutions.
  • Design and execute tests to ensure the reliability, accuracy, and performance of data processes.
  • Manage defects and issues in data pipelines, ensuring timely resolution and minimal impact on data integrity.
  • Drive process improvements in data engineering workflows to enhance efficiency and quality.
  • Identify and mitigate risks related to data engineering processes and solutions.
  • Generate reports and effectively communicate project status, quality metrics, and issues to Experience :

    Education :

    - Bachelor's degree or higher in Computer Science, Information Technology, Data Science, Engineering, or a related field.

    - Advanced degrees (Master's, PhD) can be advantageous but are not always necessary.

    Experience :

    - Previous experience as a data engineer or a related role is typically required, preferably within a cloud environment.

    - Hands-on experience with implementing data solutions using GCP services.

    Skills :
    • Bachelor's degree or higher in Computer Science, Information Technology, Data Science, Engineering, or a related field.
    • Proficiency in Google Cloud Platform (GCP) services, particularly those related to data engineering such as BigQuery, Dataflow, Cloud Storage, Cloud Pub/Sub, and Data Catalog.
    • Strong understanding of SQL for data manipulation and querying in BigQuery.
    • Experience with data modeling concepts and techniques.
    • Familiarity with version control systems like Git.
    • Knowledge of Dataform or other data orchestration and modeling tools is highly desirable.
    • Proficiency in programming languages commonly used in data engineering such as Python, Java, or Scala.
    • Experience with scripting languages like Bash for automation tasks.
    • Understanding of software engineering best practices, including code optimization, testing, and debugging.
    • Solid understanding of data warehousing concepts and methodologies.
    • Experience in designing, building, and optimizing ETL (Extract, Transform, Load) pipelines.
    • Knowledge of data governance and compliance standards.
    • Ability to work with structured and unstructured data formats.
    • Hands-on experience with implementing data solutions using GCP services.
    • Experience in developing and maintaining scalable and reliable data pipelines.
    • Familiarity with agile development methodologies and practices.
    • Strong problem-solving skills and the ability to troubleshoot complex data engineering issues.
    • Strong communication skills with the ability to collaborate effectively with cross-functional teams including data scientists, analysts, and business stakeholders.
    • Adaptability and willingness to learn new technologies and methodologies.
    • Attention to detail and a commitment to producing high-quality work.
    • Project management skills to effectively prioritize tasks and meet deadlines.
    Behavioral Competencies :
    • Must have worked with US/Europe based clients in onsite/offshore delivery model,
    • Should have very good verbal and written communication, technical articulation, listening and presentation skills
    • Should have proven analytical and problem-solving skills
    • Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills
    • Should be a quick learner, self-starter, go-getter and team player
    • Should have experience of working under stringent deadlines in a Matrix organization structure
    • Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations

    (ref:hirist.tech)

  • Data Engineer

    4 days ago

    Anywhere in India/Multiple Locations, IN AAR Consultancy Full time

    Technical Skills :1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage.2. Data Engineering : Strong understanding of data engineering principles, including data ingestion, transformation, processing, and storage.3. Big Data Technologies :...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Change leaders Full time

    Primary Skill - GCP + Python + SQLORGCP + Java + SQL NP - Immediate to 35 Days maxJob Location - Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida- Bachelor's degree in computer science or a related discipline- 6+ years of applicable engineering experience- Experience in GCP, Big Query- Strong proficiency in Python with an emphasis in...

  • Big Data Developer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Risk Resources LLP Full time

    Responsibilities :- Lead and mentor a team of Big Data engineers in designing, developing, and deploying big data solutions on GCP- Define the technical vision and roadmap for big data architecture within the organization- Architect and implement scalable, high-performance big data pipelines using technologies like MapReduce, Hive, Spark, and BigQuery-...

  • Sigmoid Analytics

    3 weeks ago

    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • Sigmoid Analytics

    3 weeks ago

    Anywhere in India/Multiple Locations, IN ASTAR DATA LLP Full time

    Job Description :This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN consultancy Full time

    Note : It's a work-from-home opportunity.Skills You must have experience with:- Twilio Segment - Customer Data Platform- Google Analytics (Inc. Firebase)- Experience creating tailored dashboards using PowerBi- Experience in data management, data warehousing, data quality, data lakes, data marts- Deep understanding of data platform technologies, SQL...

  • GCP Data Engineer

    3 weeks ago

    Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full time

    Job Description :Must-Have :- 5+ Years of Experience in Data Engineering and building and maintaining large-scale data pipelines.- Experience with designing and implementing a large-scale Data-Lake on Cloud Infrastructure - Strong technical expertise in Python and SQL- Extremely well-versed in Google Compute Platform including BigQuery, Cloud Storage, Cloud...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations/Pune, IN Rocket Consulting Full time

    A Data Engineer/developer having good experience working withPrimary skills : Python, AirFlow - ETL skills - GCPSecondary skills : Google Cloud Composer - Google Big Query - Google Cloud- Storage - SQL - MS SQL Serve- Proven experience as a Data Engineer/Developer with expertise in Python, Airflow, and GCP.- Strong understanding of ETL concepts and best...

  • Google BigQuery Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations, IN Optivalue tek consulting Full time

    Summary : As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Google BigQuery. Your typical day will involve working with the development team, analyzing business requirements, and developing solutions to meet those requirements.Roles &...

  • GCP Data Architect

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Huquo Full time

    Role : GCP Data Architect Description : As a GCP Data Architect, you will be responsible for architecting enterprise data solutions for migration, transformation or modernization on Google Cloud Platform (GCP) integrating native GCP services and other 3rd party data solutions. You will collaborate with cloud partners and our cross-functional teams to enable...

  • Senior Data Engineer- Spark/Python

    3 weeks ago

    Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Azure Databricks Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Talent-Max Consultant Full time

    Experience: 4-7 YearsLocation : Bhilai, Indore, BangaloreJob Description :We are seeking a skilled DataBricks Engineer to join our team. In this role, you will be responsible for engineering reliable data pipelines for sourcing, processing, distributing, and storing data in various ways using cloud data platform infrastructure. Your primary focus will be on...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN SKEP IT SYSTEMS Full time

    Job Description :We are seeking a skilled Python + SQL with DBT Developer to join our growing team. As a Python + SQL with DBT Engineer, you will be responsible for designing, developing, and maintaining data models and transformations using DBT to create analysis-ready datasets. You will also be responsible for building and optimizing ETL pipelines using...

  • Google Cloud Platform Architect

    3 weeks ago

    Anywhere in India/Multiple Locations/Pune/Bangalore/Gurgaon/Gurugram/Mumbai, IN Vikisol Technologies Full time

    Job Title : GCP ArchitectLocation : Pune, Bangalore, Gurgaon, MumbaiExperience : 7+ YearsJob Description :We are seeking a skilled GCP Architect with over 7 years of experience to join our team. The ideal candidate will have a strong proficiency in Google Cloud Platform (GCP) services, particularly Data Fusion, BigQuery, and Composer (Airflow)....

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Liveconnections Full time

    Skillset:- Data Engineering with strong SQL expertise.- Should be good in Talend, Snowflake. More preference to certified (in Talend/ Snowflake) resources.- Should be experienced in implementing DWH projects.- Having Informatica experience will be value-add.Relevant Experience: 3-6 yearsLocation: India Work Mode: RemoteImmediate Joiners are preferred- 2...

  • Data Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full time

    This is a full-time on-site role for a GCP Data Engineer. As a Data Engineer, your responsibilities will include data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Job Description :- You will work closely with the development team to design and implement data solutions to meet the organization's needs.-...

  • Software Engineer II

    3 weeks ago

    Anywhere in India/Multiple Locations, IN HyrEzy Talent Solutions Full time

    Position : Software Engineer IIExperience : 2 - 5 YearsLocation : Bangalore : WFO(not initiated yet)Role Overview :The Sr. Software Engineer will be an individual contributor responsible for developing high-quality software solutions using Python, Postgres, React, Typescript, and BigQuery. The ideal candidate should have 2-5 years of experience in software...

  • Data Architect

    3 weeks ago

    Pune/Hyderabad/Anywhere in India/Multiple Locations, IN Huquo Full time

    Job Description :- SQL, Python and Java , Data Modelling, Hadoop Platform, Cloud Platform(GCP preferable)- Developing and implementing an overall organisational data strategy that is in line with business processes.- The strategy includes data model designs, database development standards, implementation and management of data warehouses and data analytics...

  • Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations/Any Location, IN HyrEzy Talent Solutions Full time

    Title : Data Engineer - SQL , PLSQL, ETL (IBM Data Stage)Location : RemoteType : Full TimeJob Role : We are looking for an experienced SQL , PLSQL and Data Stage ETL developer to join our team as a Data Engineer who will work as part of a team to help design and develop data-driven solutions that deliver insights to the business. The ideal candidate is a...