Data Engineer

2 weeks ago

Bangalore Urban, India EMB Global Full time

ONLY APPLY IF

  • Available to join in Bangalore - Work from Office
  • Startup and product experience is a must
  • You are available to join within 15-20 days
  • B.tech from Tier I institute is a must



Basic Qualifications

  • Bachelor’s Degree in Computer Science, Engineering, or a related technical field from a Tier-I institution.
  • Proven experience as a Data Engineer with expertise in ETL techniques (3+ years) is a MUST
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Skillset to scrape and transform data off of the publicly available web sources
  • Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
  • Proficiency in SQL and experience working with relational and non-relational databases.
  • Knowledge of data warehousing concepts and architectures.
  • Familiarity with big data technologies such as Hadoop, Spark, and Kafka.
  • Experience with data modeling tools and techniques.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.


Preferred Qualifications

  • Master's degree or equivalent in Computer Science/ Data Science
  • Knowledge of data streaming and real-time processing.
  • Familiarity with data governance and security best practices.


Key Responsibilties :

ETL Development:

  • Design, develop, and maintain efficient ETL processes for multi-scale data sets.
  • Implement and optimize data transformation and validation processes to ensure data accuracy and consistency.
  • Collaborate with cross-functional teams to understand data requirements and business logic.


Data Pipeline Architecture:

  • Architect, build and maintain scalable and high-performance data pipelines
  • Evaluate and implement new technologies to enhance data pipeline efficiency and reliability
  • Pipelines for extracting data through scraping for ad-hoc sector specific datasets


Data Modelling:

  • Develop and implement data models to support analytics and reporting needs.
  • Optimize database structures for performance and scalability.


Data Quality and Governance:

  • Implement data quality checks and governance processes to ensure data integrity.
  • Collaborate with stakeholders to define and enforce data quality standards.

Documentation and Communication:

  • Document ETL processes, data models, and other relevant information.
  • Communicate complex technical concepts to non-technical stakeholders effectively.


Cross-functional collaboration:

  • Collaborate internally with the Quant team and developers to lay and optimize the data pipelines and externally with the stakeholders to understand the business requirements for the enrichment of the cloud database

  • Data Engineer

    2 months ago

    Bangalore Urban, India Acuity Knowledge Partners Full time

    We are looking for a senior data engineer who will help us source, validate, and manage financial data using state-of-the-art data mining algorithms. The role involves leveraging the latest data mining techniques, designing validation engines, error monitoring, and conducting root cause analysis. The candidate will also be responsible for statistical...

  • Senior Data Engineer

    3 days ago

    Bangalore Urban, India ThoughtFocus Full time

    Job Description: Senior Data EngineerPosition: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-TimeMust have experience in Capital Market/Investment banking/BFSI domain.ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary:We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL, Python, Pyspark...

  • Senior Data Engineer

    3 days ago

    Bangalore Urban, India ThoughtFocus Full time

    Job Description: Senior Data Engineer Position: Senior Data Engineer Experience: 8-13 Years Location: Bangalore Employment Type: Full-Time Must have experience in Capital Market/Investment banking/BFSI domain. ONLY IMMEDIATE JOINERS (0-15 DAYS) Summary: We are looking for a highly skilled Senior Data Engineer with 8-13 years of experience in SQL,...

  • Data Engineer

    3 weeks ago

    Bangalore Urban, India EMB Global Full time

    ONLY APPLY IF Available to join in Bangalore - Work from Office Startup and product experience is a must You are available to join within 15-20 days B.tech from Tier I institute is a must Basic Qualifications Bachelor’s Degree in Computer Science, Engineering, or a related technical field from a Tier-I institution . Proven experience as a Data...

  • Data Engineer

    7 days ago

    Bangalore Urban, India Xebia Full time

    Founded in 2001, Xebia was the first Dutch organization to embrace the Agile way of working, with gurus like Jeff Sutherland. Since then, we have grown from a Java company into a full-service digital consulting company with 5,000 professionals working on a worldwide ambition.We are organized in complementary chapters – teams with a tremendous amount of...

  • Data Engineer

    7 days ago

    Bangalore Urban, India Xebia Full time

    Founded in 2001, Xebia was the first Dutch organization to embrace the Agile way of working, with gurus like Jeff Sutherland. Since then, we have grown from a Java company into a full-service digital consulting company with 5,000 professionals working on a worldwide ambition. We are organized in complementary chapters – teams with a tremendous amount of...

  • Data engineer

    1 month ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost...

  • Data Engineer

    2 months ago

    Bangalore Urban, India Expand My Business Full time

    Details Contract : 6 months to start with.Experience 4-6yrs of experienceLocation: Onsite (Bangalore)Joining : Within 15 days.Basic QualificationsBachelor's degree in Computer Science, Information Technology, or a related field.Proven experience as a Data Engineer with expertise in ETL techniques (2+ years) is a MUSTStrong programming skills in languages...

  • Solution Engineer

    2 months ago

    Bangalore, Karnataka, India HEVO DATA Full time

    Overview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...

  • Data Engineer

    2 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. - Lead the architecture, design, and delivery of enterprise grade microservices. - Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    1 month ago

    Bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data Engineer Location: Yemalur, Bangalore Your Key Responsibilities: Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders. Lead the architecture, design, and delivery of enterprise grade microservices. Deliver assigned projects within budgeted time, cost and...

  • Data Engineer

    2 months ago

    Bangalore Urban, India Tata Consultancy Services Full time

    TCS is Hiring!!Job Role: Data EngineerLocation: BLR/CHN/KOC/PAN INDIAExperience Required: 6+yrsJob Description:Having 3-8 years of technical and functional experience in the IT industry. Development experience with python Pandas, NumPy, Snowflake and Snowpark. Implementing ETL pipelines within and outside of a data warehouse using Python and Snowflakes Snow...

  • Data Engineer

    2 months ago

    Bangalore Urban, India Tata Consultancy Services Full time

    TCS is Hiring!! Job Role: Data Engineer Location: BLR/CHN/KOC/PAN INDIA Experience Required: 6+yrs Job Description: Having 3-8 years of technical and functional experience in the IT industry. Development experience with python Pandas, NumPy, Snowflake and Snowpark. Implementing ETL pipelines within and outside of a data warehouse using Python and...

  • Senior Data Engineer

    1 month ago

    Bangalore Urban, India AceNet Full time

    Job Overview:We are seeking a highly skilled Senior Data Engineer with specialized expertise in Snowflake to join our growing team. The ideal candidate will have exceptional SQL skills, coupled with experience in DBT and Fivetran. This role involves designing and implementing scalable data pipelines, optimizing performance within Snowflake environments, and...

  • Senior Data Engineer

    1 month ago

    Bangalore Urban, India AceNet Full time

    Job Overview: We are seeking a highly skilled Senior Data Engineer with specialized expertise in Snowflake to join our growing team. The ideal candidate will have exceptional SQL skills, coupled with experience in DBT and Fivetran. This role involves designing and implementing scalable data pipelines, optimizing performance within Snowflake environments,...

  • Data Engineer

    3 weeks ago

    bangalore, India Data Labs - LANDMARK GROUP Full time

    Job Title: Lead Data EngineerLocation: Yemalur, BangaloreYour Key Responsibilities:Lead our engineering team successfully build and deploy cutting edge analytics products for consumption by different stakeholders.Lead the architecture, design, and delivery of enterprise grade microservices.Deliver assigned projects within budgeted time, cost and agreed...

  • Principal Data Engineer

    2 months ago

    Bangalore Urban, India Taglynk Full time

    Job Summary:The Principal Data Engineer is responsible for leading the design, development, and optimization of scalable data pipelines, data lakes, and large-scale datasets. With over 9 years of experience in data engineering and expertise in tools like ElasticSearch, Redshift, and data lakes, this role ensures the efficient processing and storage of...

  • Principal Data Engineer

    2 months ago

    Bangalore Urban, India Taglynk Full time

    Job Summary: The Principal Data Engineer is responsible for leading the design, development, and optimization of scalable data pipelines, data lakes, and large-scale datasets. With over 9 years of experience in data engineering and expertise in tools like ElasticSearch, Redshift, and data lakes, this role ensures the efficient processing and storage of...

  • Senior Data Engineer

    1 month ago

    Bangalore Urban, India Quantiphi Full time

    Role & Responsibilities: As a Data Engineer, you will play a pivotal role in designing, developing, and optimizing data pipelines on Google Cloud Platform (GCP). Your primary responsibility will be to ensure efficient data flow and seamless integration with GCP services while adhering to best practices and data architecture standards. Should be comfortable...