Data Engineer

3 weeks ago


BangaloreMumbaiPuneChennaiKolkataNoida, IN Change leaders Full time

Primary Skill :


- GCP + Python + SQL

OR

- GCP + Java + SQL

NP : Immediate to 35 Days max

Job Location : Mumbai / Pune / Chennai / Bangalore / Hyderabad / Kolkata / Noida

- Bachelor's degree in computer science or a related discipline

- 6+ years of applicable engineering experience

- Experience in GCP, Big Query

- Strong proficiency in Python with an emphasis in building data pipelines

- Ability to write complex SQL to perform common types of analysis and aggregations

- Experience with Apache Airflow or Google Composer

- Detail-oriented and document all the work

- Ability to work with others from diverse skill-sets and backgrounds

- GCP solution architect - certified

Responsibilities :

- Design, develop, and deploy scalable and reliable data pipelines on Google Cloud Platform using services such as Cloud Dataflow, Apache Beam, or Apache Spark on Dataproc.

- Work closely with data scientists and analysts to understand data requirements and implement solutions that enable efficient data processing, analysis, and visualization.

- Build and maintain data ingestion processes from various sources (e.g. databases, APIs, streaming data) into GCP data storage solutions like BigQuery, Cloud Storage, and Cloud SQL.

- Optimize and tune data pipelines for performance, scalability, and cost-effectiveness.

- Implement data security and compliance measures to ensure data integrity and privacy.

- Collaborate with cross-functional teams to support data-driven decision-making and business intelligence initiatives.

- Stay updated with the latest trends and best practices in data engineering and GCP services.

Requirements :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Proven experience as a data engineer with a focus on designing and building data pipelines and analytics solutions.

- Hands-on experience with Google Cloud Platform services, particularly BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.

- Proficiency in programming languages such as Python, Java, or Scala for data processing and pipeline development.

- Strong understanding of data modeling, database design principles, and SQL.

- Experience with workflow orchestration tools like Apache Airflow or Google Cloud Composer.

- Familiarity with DevOps practices and tools for CI/CD, version control, and infrastructure as code.

- Excellent problem-solving and analytical skills.

- Effective communication and collaboration skills.

(ref:hirist.tech)
  • Data Engineer

    3 weeks ago


    Bangalore/Noida, IN Xperthunt Full time

    About the Role :We're seeking a highly skilled Data Engineer to join our team and play a pivotal role in building and maintaining our data infrastructure.You'll collaborate closely with data scientists, analysts, and stakeholders to understand their data needs and design, develop, and implement data solutions that empower effective analysis and...

  • Python Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full time

    Job Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...

  • Data Engineer

    3 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...

  • Data Engineer

    3 weeks ago


    Mumbai/Chennai/Pune/Bangalore, IN Coders Brain Pvt Ltd Full time

    JD - Python and Snowflake- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.- Responsible for Cloud migrations for data pipelines using AWS and Snowflake- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning,...

  • Senior Data Engineer

    3 weeks ago


    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Data Engineer

    3 weeks ago


    Mumbai/Bangalore/Chennai/Pune, IN LanceTech Solutions Full time

    Data Engineer - SQL, PLSQL, Snowflake, ETLWe're seeking an experienced Data Engineer with expertise in SQL, strong PLSQL skills, Snowflake, and ETL development. As a key member of our team, you'll design and implement data-driven solutions, collaborating with software developers, database architects, and data scientists. Your role involves building...

  • Junior Data Engineer

    3 weeks ago


    Bangalore/Noida, IN Xperthunt Full time

    About the Role :We're seeking a passionate and detail-oriented Junior Data Engineer to join our growing team! In this role, you'll play a vital role in designing, developing, and maintaining data pipelines to support our organization's data-driven initiatives.You'll work closely with data analysts, scientists, and other engineers to ensure...

  • Data Engineer

    3 weeks ago


    Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Chennai, IN VIDPRO CONSULTANCY SERVICES Full time

    Mandatory Skills : Snowflake/Azure Data Factory/ PySpark / DatabricksPrimary Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development...

  • GCP Developer

    1 week ago


    Bangalore/Pune/Noida/Hyderabad/Chennai, IN Nilasu consulting Full time

    JOB DESCRIPTION:Must Have: - Min 3 years' Experience with Building Pipelines using GCP-Big-Query - Min 2-3 Experience in working on Large Scale Data warehouses like Teradata - Experience building and optimizing data warehousing data pipelines (ELT and ETL), architectures and data sets. - Advanced working SQL knowledge and experience working with...


  • Bangalore/Hyderabad/Chennai/Pune, IN CGI Information Systems and Management Consultants Full time

    Required Skills :- 5+ years of experience in database administration duties- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline- Experience in building or maintaining ETL processes.- Experienced in working with big data analytics tools.- Need to be proficient in various database types and...

  • AWS Data Engineer

    3 days ago


    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • Data Engineer

    7 days ago


    Bangalore/Pune/Kolkata/Gurgaon/Gurugram/Mumbai/Ahmedabad, IN Sterlite Technologies Limited Full time

    Role as a Data engineer :- Develop and build AI/ML model ready data ponds using Azure Databricks Delta lake- Improve upon the data ingestion models, ETL jobs, and alarm to maintain data integrity and data availability.- Partner with AI/ML product teams proactively identify the data needs for rapid experimentation, stable production deployment and ensure the...

  • Azure Data Engineer

    2 weeks ago


    Bangalore/Pune/Kolkata/Chennai/Gurgaon/Gurugram, IN VIDPRO CONSULTANCY SERVICES Full time

    Primary Roles and Responsibilities:- Developing Modern Data Warehouse solutions using Databricks and Azure Stack - Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines and fix the...

  • Big Data Engineer

    3 weeks ago


    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...

  • Data Engineer

    3 weeks ago


    Pune/Bangalore/Chennai, IN ADVANSOFT Full time

    Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and...

  • Azure Data Engineer

    3 weeks ago


    Chennai/Pune/Mumbai/Bangalore/Coimbatore/Ahmedabad, IN CHAITANYA PLACEMENT Full time

    Company Name : MNCPosition : Permanent (Hybrid)Job Location : Notice Period : Immediate preferredWe are seeking a talented Azure Data Factory Developer to join our team. The ideal candidate will have extensive experience in data engineering and a strong background in developing data pipelines using Azure Data Factory. This individual will be responsible for...

  • Valiance Solutions

    3 weeks ago


    Noida/Bangalore/Mumbai, IN Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • AI/ML Engineer

    3 weeks ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    Summary :We are seeking a talented and passionate AI/Machine Learning Engineer to join our team. You will play a key role in the entire lifecycle of machine learning projects, from data engineering and classical machine learning to potentially exploring deep learning and natural language processing techniques. Your strong foundation in Python coding,...

  • Lead Data Engineer

    1 week ago


    Bangalore/Pune/Hyderabad/Chennai, IN Nilasu consulting Full time

    We are seeking a highly skilled and experienced Data Engineer with a passion for the healthcare industry to join our growing team!In this pivotal role, you will play a key role in building and maintaining our data lake infrastructure. You will leverage your expertise in data pipelines, cloud technologies, and healthcare data to design, develop, and deploy...

  • Data Engineer

    3 weeks ago


    Bangalore/Pune, IN vipsa solutions Full time

    SALARY : 15LPA - Engineer:Location: Pune, BangaloreExperience: 6-9 yearsNP: Immediate- 15 daysKey accountabilities:As a Data Engineer you will be accountable for:- Understanding operational needs by collaborating with specialized teams- Supporting key, involves architecture designing, building and deploying data systems, pipelines etc- Build agile, scalable,...