Current jobs related to Senior Data Engineer - Delhi, Delhi - Koantek


  • New Delhi, 110045, South West Delhi, India Leidos Full time

    Description Duties and responsibilities will include performing a wide variety of technical support activities by installing, troubleshooting, maintaining and servicing x-ray and CT based security systems at customer sites. Typically handles complex products and/or problems, and may provide technical guidance to lower level technicians. Helps develop and...

  • Senior Data Scientist

    3 hours ago


    new delhi, India Facts 'n' Data Full time

    Company Description Facts 'n' Data is an R&D based advanced (Big) Data Analytics & Text Mining organization located in New Delhi. We specialize in helping businesses (of all size) by solving their complex issues through scientific data analysis, leveraging on Statistical Modeling, Artificial Intelligence, Machine Learning, NLP, and more. Founded by Data...


  • New Delhi, India Facts 'n' Data Full time

    Company DescriptionFacts 'n' Data is an R&D based advanced (Big) Data Analytics & Text Mining organization located in New Delhi. We specialize in helping businesses (of all size) by solving their complex issues through scientific data analysis, leveraging on Statistical Modeling, Artificial Intelligence, Machine Learning, NLP, and more. Founded by Data...

  • Senior Data Scientist

    6 hours ago


    New Delhi, India Facts 'n' Data Full time

    Company Description Facts 'n' Data is an R&D based advanced (Big) Data Analytics & Text Mining organization located in New Delhi. We specialize in helping businesses (of all size) by solving their complex issues through scientific data analysis, leveraging on Statistical Modeling, Artificial Intelligence, Machine Learning, NLP, and more. Founded by Data...

  • Senior Data Scientist

    12 hours ago


    New Delhi, India Facts 'n' Data Full time

    Company DescriptionFacts 'n' Data is an R&D based advanced (Big) Data Analytics & Text Mining organization located in New Delhi. We specialize in helping businesses (of all size) by solving their complex issues through scientific data analysis, leveraging on Statistical Modeling, Artificial Intelligence, Machine Learning, NLP, and more. Founded by Data...


  • Delhi, India MindBrain Full time

    Company DescriptionAt MindBrain, we integrate innovation, education, and strategic workforce solutions to shape the future of technology. As pioneers in cutting-edge solutions, we are dedicated to nurturing talent through IT and non-IT training. Our focus on software innovation, educational excellence, and workforce solutions creates an ecosystem where...


  • delhi, India RapidBrains Full time

    Job Title: Senior Data Engineer Experience: 5-9 Years Location: Bangalore Notice Period: 0 - 30 Days Job Description: As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines, working with cutting-edge tools like Python, DBT, and Databricks. Your primary focus will be transforming raw data...


  • delhi, India RapidBrains Full time

    Job Title: Senior Data EngineerExperience: 5-9 YearsLocation: BangaloreNotice Period: 0 - 30 DaysJob Description:As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines, working with cutting-edge tools like Python, DBT, and Databricks. Your primary focus will be transforming raw data into...


  • delhi, India True Tech Professionals Full time

    Senior Data EngineerKey Skills: Snowflake, Python, PysparkExperience: 6+ YearsEmployment Type: Full-timeAvailability: Immediate Joiners PreferredJob Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on Snowflake,...

  • Senior Data Engineer

    3 weeks ago


    Delhi, India emagine Full time

    Job Title: Senior GCP Data EngineerExperience Level: Minimum 7 YearsLocation: RemoteJob Overview:We are seeking a highly experienced Senior GCP Data Engineer with a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including Dataflow, and...


  • delhi, India emagine Full time

    Job Title:Senior GCP Data EngineerExperience Level:Minimum 7 YearsLocation:(Specify Location)Job Overview:We are seeking a highly experiencedSenior GCP Data Engineerwith a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including Dataflow, and...

  • Senior Data Engineer

    1 month ago


    Delhi, India TTEC Digital Full time

    We are seeking a proactive and experienced Senior Data Engineer to join our team. The ideal candidate will have a strong technical background in data engineering and a proven track record of taking ownership of complex data projects. You will leverage your expertise in Azure, PySpark, and Databricks to design, develop, and manage scalable data solutions...

  • Senior Data Engineer

    3 weeks ago


    Delhi, India emagine Full time

    Job Title:Senior GCP Data EngineerExperience Level:Minimum 7 YearsLocation:(Specify Location)Job Overview:We are seeking a highly experiencedSenior GCP Data Engineerwith a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including Dataflow, and...

  • Senior Data Engineer

    2 weeks ago


    Delhi, India Programmers.io Full time

    Programmers.Io is looking for Senior Data EngineerJob Description: Job Title: Azure Data Engineer Shift Timings: 12 PM - 9 PM Location: Jaipur Experience required: 5 to 10 years Key Responsibilities:Design and develop scalable data pipelines using Databricks and Azure Data Factory.Implement and optimize data warehousing solutions and Synapse Analytics...

  • Senior Data Engineer

    2 weeks ago


    Delhi, India Programmers.io Full time

    Programmers.Io is looking for Senior Data EngineerJob Description:Job Title: Azure Data EngineerShift Timings: 12 PM - 9 PMLocation: JaipurExperience required: 5 to 10 yearsKey Responsibilities:Design and develop scalable data pipelines using Databricks and Azure Data Factory.Implement and optimize data warehousing solutions and Synapse Analytics for...

  • Senior Data Engineer

    3 weeks ago


    new delhi, India emagine Full time

    Job Title: Senior GCP Data EngineerExperience Level: Minimum 7 YearsLocation: (Specify Location)Job Overview:We are seeking a highly experienced Senior GCP Data Engineer with a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including...

  • Senior Data Engineer

    3 weeks ago


    new delhi, India Insight Global Full time

    Insight Global is looking for a Senior Data Engineer to work remotely in India. Candidates will work IST hours. Candidates will be a part of the clients data modernization project, transitioning from on-premises to cloud infrastructure (Azure). They will utilize programming skills in SQL, PySpark, and Python to support data transformation and migration...

  • Senior Data Engineer

    2 weeks ago


    delhi, India Accordion India Full time

    Company OverviewAccordion works at the intersection of sponsors and management teams throughout every stage of the investment lifecycle, providing hands-on, execution-focused support to enhance the capabilities of the CFO's office.So, what does it mean to work at Accordion? It means joining 1,000+ analytics, finance & technology experts in a high-growth,...

  • Senior Data Engineer

    2 weeks ago


    delhi, India S&P Global Full time

    Position summaryAs a Senior Data Engineer in the Automotive Insights - Supply Chain and Technology and Aftermarket department at S&P Global, you will leverage advanced data engineering techniques to manage and optimize data pipelines within the automotive industry. Your primary responsibilities will include designing, building, and maintaining scalable data...

  • Data Engineer

    3 weeks ago


    new delhi, India CX Data Labs Full time

    Data EngineerAbout CX Data Labs: At CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies, bridging the gap between...

  • Data Engineer

    2 weeks ago


    New Delhi, India CX Data Labs Full time

    Data Engineer About CX Data Labs: At CX Data Labs, we believe that by systematically understanding and adapting to changing customer preferences, companies can sustainably grow their business. We help our clients realize this vision through our advisory and implementation services in Digital, Data, and Analytics competencies, bridging the gap between...

Senior Data Engineer

3 months ago


Delhi, Delhi, India Koantek Full time

About the Company:
Koantek is a consulting firm that provides customized solutions to tackle the most challenging business
problems through data and machine learning. With decades of combined experience, Koantek uses
extensive industry-specific research and deep technical knowledge to guide companies on how to
modernize their business, make better decisions, and embrace technology that challenges the status
quo. We operate in the BI/AI tech space with emphasis on Data engineering, analytics, architecture, and
security. Our projected growth for the year in terms of people numbers is 300 for 2023. Most of the
expansion will happen in India and we are looking to engage top talent here.

Job Description:
The Senior Data Engineer with Databricks experience at Koantek will use comprehensive modern data
engineer techniques and methods with Advanced Analytics to support business decisions for our clients.
You will help design and build data pipelines, data streams, reporting tools, information dashboards, data
service APIs, data generators, and other end-user information portals and insight tools. You will be a
critical part of the data supply chain, ensuring that stakeholders can access and manipulate data for
routine and ad hoc analysis to drive business outcomes using Advanced Analytics

Role:
Senior Data Engineer (cloud platform: AWS / GCP)

Job Requirements:

  • Strong experience as a data engineer (Databricks preferred)
  • Expert proficiency in Spark Scala,Advanced SQL & Python (mandate), and PySpark is a plus
Must have data migration experience from on prem to cloud

  • Hands-on experience in Kinesis to process & analyze Streaming data, and cloud DynamoDB
In depth understanding of cloud, data lake, and analytics solutions.

  • Expert level hands-on development in designing and developing applications on Databricks,
Databricks Workflows, cloud Managed Airflow, and Apache Airflow is required.

  • Extensive hands-on experience implementing data migration and data processing using Cloud

services:
VPC/SG, EC2, S3, AutoScaling, CloudFormation, LakeFormation, DMS, Kinesis, Kafka,
Nifi, CDC processing, Amazon S3, EMR, Redshift, Athena, Snowflake, RDS, Aurora, Neptune,
DynamoDB, Cloudtrail, CloudWatch, Docker, Lambda, Spark, Glue, SageMaker, AI/ML, API GW,
etc.

  • Hands-on experience with the Technology stack available in the industry for data management,
data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map
Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc.

  • Knowledge of different programming and scripting languages
  • Good working knowledge of code versioning tools [such as Git, Bitbucket or SVN]
  • Hands-on
experience in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair

  • Experience preparing data for use in SageMaker and Databricks.
  • Demonstrated experience preparing data, automating and building data pipelines for AI Use
Cases (text, voice, image, IoT data etc....).

  • Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark
Scala, Spark SQL/PySpark

  • Knowledge of any cloud DevOps processes like CI/CD as well as Agile tools and processes
including Git, Jenkins, Jira, and Confluence

  • Strong understanding of Data Modeling and defining conceptual logical and physical data
models.

Responsibilities:

  • Work closely with team members to lead and drive enterprise solutions, advising on key decision
points on trade-offs, best practices, and risk mitigation

  • Manage data related requests, analyze issues, and provide efficient resolution. Design all
program specifications and perform required tests

  • Design and Develop data Ingestion using Glue, Any cloud Managed Airflow, Apache Airflow and
processing layer using Databricks.

  • Work with the SMEs to implement data strategies and build data flows and prepare codes for all
modules according to required specification.

  • Monitor all production issues and inquiries and provide efficient resolution.
  • Evaluate all
functional requirements, map documents, and troubleshoot all development processes

  • Document all technical specifications associate project deliverables and design all test cases
to provide support to all systems and perform unit tests.

Must have skills:
AWS / GCP, Spark, Python, SQL, Pyspark (Databricks good to have)

Location:
PAN India

Work Mode:
Remote