Data Engineer

1 month ago

Bengaluru, Karnataka, India Awign Expert Full time
About Awign Expert

A division of Awign, India's largest work-as-a-service platform, connecting skilled professionals with exciting project-based opportunities from top companies, handling onboarding, feedback, conflict resolution, and payroll.

Job Summary

We are seeking a highly skilled Data Engineer to join our Data Science team. As a Data Engineer, you will play a critical role in enriching and maintaining our central repository of datasets, leveraging advanced data analytics and machine learning techniques to extract actionable insights from financial and market data.

Key Responsibilities
  • ETL Development: Design, develop, and maintain efficient ETL processes for multi-scale data sets, collaborate with cross-functional teams to understand data requirements and business logic.
  • Data Pipeline Architecture: Architect, build, and maintain scalable and high-performance data pipelines, evaluate and implement new technologies to enhance data pipeline efficiency and reliability, pipelines for extracting data through scraping for ad-hoc sector-specific datasets.
  • Data Modelling: Develop and implement data models to support analytics and reporting needs, optimize database structures for performance and scalability.
  • Data Quality and Governance: Implement data quality checks and governance processes to ensure data integrity, collaborate with stakeholders to define and enforce data quality standards.
  • Documentation and Communication: Document ETL processes, data models, and other relevant information, communicate complex technical concepts to non-technical stakeholders effectively.
  • Cross-functional collaboration: Collaborate internally with the Quant team and developers to lay and optimize the data pipelines and externally with stakeholders to understand the business requirements for the enrichment of the cloud database.

Requirements: Bachelor's degree in Computer Science, Information Technology, or a related field, proven experience as a Data Engineer with expertise in ETL techniques, strong programming skills in languages such as Python, Java, or Scala, experience with cloud-based data platforms (e.g., AWS, Azure, GCP), proficiency in SQL and experience working with relational and non-relational databases, knowledge of data warehousing concepts and architectures, familiarity with big data technologies such as Hadoop, Spark, and Kafka, experience with data modeling tools and techniques, excellent problem-solving and analytical skills, strong communication and collaboration skills.

Preferred Qualifications: Master's degree or equivalent in Computer Science/Data Science, knowledge of data streaming and real-time processing, familiarity with data governance and security best practices.

  • Data Engineering Expert

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.

  • Data Engineering Director

    5 days ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Engineering Leadership OpportunityThis is a unique chance to own and build scalable platform services that support thousands of customers' data pipelines, ensuring load data reliability to cloud warehouses.The Hevo platform core services will provide no-code-low pipeline building capabilities, making a significant impact on the company's business.About the...

  • Data Engineering Manager Lead

    5 days ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Scale Data Pipeline Services with HevoWe are seeking an experienced Data Engineering Manager to lead the development of scalable platform services supporting thousands of customers' data pipelines.This role offers a unique opportunity to build and own critical components of our cloud warehouse solution, ensuring reliable data loading and streamlining...

  • Data Engineering Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...

  • Cloud Data Engineer for Big Data Solutions

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...

  • Data Engineering Lead with Scalable Platforms

    5 days ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Unlock Career Growth as a Data Engineering LeadWe're seeking an exceptional Data Engineering Lead to join our team at Hevo Data. In this role, you'll have the opportunity to own and build scalable platform services that support thousands of customers' data pipelines and ensure load data reliability to cloud warehouses.The Hevo platform core services will...

  • Chief Data Engineering Lead

    4 days ago

    Bengaluru, Karnataka, India Data Inc Full time

    About the RoleWe are seeking a highly skilled Chief Data Engineering Lead to join our team at Data Inc.This is an exciting opportunity to lead the development and implementation of architecture strategy and standards pertinent to the domain, and establish Standards and Best practices.

  • AI Data Science and Engineering Leader

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: AI Data Science and Engineering LeaderAbout the Role:We are seeking a highly skilled Ai Data Science and Engineering Leader to join our team in Bangalore, India. This is an excellent opportunity for a talented individual to lead our data science and engineering efforts.Responsibilities:Develop and implement traditional machine learning algorithms...

  • Cloud Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...

  • Data Engineer for Cloud Migration and Data Pipelining Expert

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....

  • Lead Data Engineer

    1 month ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...

  • Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. As a key member of our team, you will play a crucial role in designing and implementing data pipelines, ensuring high-quality data for business insights.About the RoleThis is an exciting opportunity to work with cutting-edge technology and contribute to the growth...

  • Lead Data Engineering Manager

    2 weeks ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    About UsData Labs - LANDMARK GROUP is a leading data engineering firm committed to delivering cutting-edge analytics solutions.Job DescriptionWe are seeking an experienced Lead Data Engineering Manager to oversee the development and deployment of our analytics products. This role involves leading a team of engineers in designing, building, and deploying...

  • Senior Data Engineer for AI and Machine Learning

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data Engineer for AI and Machine LearningWe are seeking an experienced Data Scientist & AIML, GenAI Lead/Engineer to join our team in Bangalore, India.About the Role:Develop and implement traditional machine learning algorithms.Deploy at least one model in a production environment.Write and maintain Python code for data science and machine...

  • Data Science

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking an experienced Data Science & AI Engineer to lead our machine learning initiatives and drive innovation in artificial intelligence.About the RoleThe successful candidate will have a strong background in developing and implementing traditional machine learning algorithms, with experience deploying models in production environments....

  • Data Engineer Cloud Migration Specialist

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...

  • Data Insights Specialist

    6 days ago

    Bengaluru, Karnataka, India Tatras Data Full time

    Become a key player in Tatras Data's journey to revolutionize Data Science and AI. As a Data Analyst, you will contribute to developing innovative solutions that drive business outcomes.Our team is located in Bangalore/Hyderabad, with a hybrid work model allowing for flexibility. We welcome professionals with 3+ years of experience and a strong educational...

  • Cloud Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    We are seeking a skilled Cloud Data Engineer to join our team in Bangalore, India.About the JobThis role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS. You will work with multiple data sources, including structured and unstructured data, and use AWS services such as S3, Lambda, Glue, and Kinesis for data...

  • Senior Power BI Data Engineer Professional

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking a highly skilled Senior Power BI Data Engineer to join our team in Bangalore, India. This role will involve developing and implementing data engineering solutions using Power BI reporting tools.About the RoleThis is an exciting opportunity for an experienced data engineer to work with our team and contribute to the development of...

  • Senior Time Series Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Time Series Data Engineer to join our team in Bangalore, India. As a Senior Time Series Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that handle complex time series data.Key ResponsibilitiesDesign and develop scalable data pipelines...