Data Engineer

1 week ago

Bengaluru, India IKONMYTRI Full time

We are seeking a highly skilled and motivated Data Engineer to join our data platform team.

The ideal candidate will have hands-on experience in building and optimizing data pipelines and architectures using Databricks and Snowflake.

You will play a crucial role in managing our data ecosystem, ensuring data accessibility, quality, and performance to drive key business decisions.


Key Responsibilities :


- Design & Development : Architect, build, and maintain robust and scalable ETL/ELT data pipelines using Databricks (PySpark/Scala) and Snowflake. This includes ingesting, transforming, and loading data from various sources into our data platform.


- Data Modeling & Warehousing : Develop and manage dimensional and relational data models within Snowflake, ensuring efficient data organization and high-performance querying for analytics and reporting.


- Performance Optimization : Troubleshoot, debug, and optimize existing data workflows and SQL queries in Databricks and Snowflake to improve performance and reduce computational costs.


- Collaboration : Work closely with cross-functional teams, including data scientists, data analysts, and business stakeholders, to understand their data requirements and deliver reliable, well-structured datasets.


- Governance & Quality : Implement and maintain data governance frameworks, including data quality checks, lineage tracking, and security measures (e.g., RBAC, ACLs) within both Databricks and Snowflake.


- Automation & Orchestration : Utilize orchestration tools like dbt (Data Build Tool), Airflow, or Azure Data Factory to automate data pipelines and ensure seamless data flow.


- Innovation : Stay up-to-date with the latest features and best practices in Databricks and Snowflake, and propose new solutions to improve our data infrastructure.


Required Skills & Qualifications :


- Bachelor's degree in Computer Science, Engineering, or a related technical field.


- 3-6 years of hands-on experience as a Data Engineer or in a similar role.


- Proficiency in Python and advanced SQL is a must.


- Strong experience with Databricks for data processing, pipeline orchestration, and developing Spark applications.


- Extensive experience with Snowflake as a cloud data warehouse platform, including a deep understanding of its architecture (Virtual Warehouses, Snowpipe, etc.).


- Solid understanding of ETL/ELT processes, data modeling (Kimball, Inmon), and data warehousing concepts.


- Experience with at least one major cloud platform (AWS, Azure, or GCP).


- Knowledge of Azure is a plus.


- Familiarity with data governance, metadata management, and observability frameworks.


- Excellent problem-solving, analytical, and communication skills.


- Ability to work independently and as part of a team in a fast-paced, agile environment.


Good to Have Skills :


- Experience with dbt (Data Build Tool) for data transformation and data modeling.


- Knowledge of streaming technologies like Kafka or Kinesis.


- Familiarity with CI/CD tools such as Jenkins, Azure DevOps, or GitHub Actions.


- Relevant certifications, such as Databricks Certified Data Engineer or Snowflake SnowPro Core


(ref:hirist.tech)

  • Data Entry Operator

    10 hours ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Req ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...

  • Data Engineer

    5 days ago

    Bengaluru, India NTT DATA, Inc. Full time

    Req ID: We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN). "Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack...

  • Technical Lead- Data Engineer

    10 hours ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Engineer

    5 days ago

    Bengaluru, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key ResponsibilitiesData...

  • Data Engineer

    5 days ago

    Bengaluru, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    11 hours ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Senior, Data Engineer

    5 days ago

    Bengaluru, India NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive. Your day at NTT DATAThe Manager,...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Key Responsibilities -Data Management - Develop data mapping specifications and transformation rules Perform data cleansing, validation, and reconciliation activities Create and execute data conversion scripts and processes Document data...

  • Data Engineer

    5 days ago

    Bengaluru, India NTT DATA Business Solutions Full time

    Experience: 4 to 6 YearsLocation: Hybrid/Bangalore)Employment Type: Full-Time Role & responsibilities Must-Have Skills: 46 years of experience in data engineering roles. Proven experience in data migration and conversion projects (SAP or non-SAP). Strong knowledge of ETL concepts, tools, and frameworks. Proficiency in SQL, Python, or other data scripting...