Current jobs related to Senior Data Engineer - india - Koantek

  • Senior Data Engineer

    6 days ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Senior Data Engineer with over 5 years of expertise in data engineering.As a Senior Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success.Key...

  • Lead Data Engineer

    6 days ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Senior Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for success.Key...

  • Senior Data Engineer

    5 days ago

    India MindBrain Full time

    Company Description At MindBrain, we integrate innovation, education, and strategic workforce solutions to shape the future of technology. As pioneers in cutting-edge solutions, we are dedicated to nurturing talent through IT and non-IT training. Our focus on software innovation, educational excellence, and workforce solutions creates an ecosystem where...

  • Senior Data Engineer

    4 weeks ago

    India Smart Tech LLC Full time

    Company DescriptionSmart Tech LLC develops AI-driven solutions for the world's most pressing data and AI challenges. We aim to collaborate with the brightest minds to build real-world solutions that improve lives and create a better, sustainable world.Role DescriptionThis is a contract remote role for a Senior Data Engineer at Smart Tech LLC. The Senior Data...

  • Senior Data Engineer

    2 weeks ago

    India INFONET Full time

    Company Description InfoNet provides customized software solutions for businesses of all sizes, from startups to Forbes 500 enterprises. Since 1996, we've been dedicated to helping companies streamline operations, enhance customer experiences, and drive growth with cutting-edge technology. Our team of developers, engineers, and consultants delivers...

  • Senior Data Engineer

    2 weeks ago

    India emagine Full time

    Job Title: Senior GCP Data EngineerExperience Level: Minimum 7 YearsLocation: RemoteJob Overview:We are seeking a highly experienced Senior GCP Data Engineer with a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including Dataflow, and must...

  • Senior Data Engineer

    2 weeks ago

    India emagine Full time

    Job Title: Senior GCP Data Engineer Experience Level: Minimum 7 Years Location: Remote Job Overview: We are seeking a highly experienced Senior GCP Data Engineer with a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including Dataflow,...

  • Senior Data Engineer

    1 week ago

    India True Tech Professionals Full time

    Senior Data Engineer Key Skills: Snowflake, Python, PysparkExperience: 6+ YearsEmployment Type: Full-timeAvailability: Immediate Joiners PreferredJob Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on Snowflake,...

  • Senior Data Engineer

    7 days ago

    India True Tech Professionals Full time

    Senior Data Engineer Key Skills: Snowflake, Python, Pyspark Experience: 6+ Years Employment Type: Full-time Availability: Immediate Joiners Preferred Job Description: We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering, with a focus on...

  • Senior Data Engineer

    3 weeks ago

    India emagine Full time

    Job Title: Senior GCP Data EngineerExperience Level: Minimum 7 YearsLocation: [Specify Location]Job Overview:We are seeking a highly experienced Senior GCP Data Engineer with a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including...

  • Senior Data Engineer

    3 weeks ago

    India emagine Full time

    Job Title: Senior GCP Data Engineer Experience Level: Minimum 7 Years Location: (Specify Location) Job Overview: We are seeking a highly experienced Senior GCP Data Engineer with a strong background in Google Cloud Platform (GCP) services and Data Engineering tools. The ideal candidate will have extensive hands-on experience with GCP services, including...

  • Senior Data Engineer

    2 days ago

    india RapidBrains Full time

    Job Title: Senior Data EngineerExperience: 5-9 YearsLocation: BangaloreNotice Period: 0 - 30 DaysJob Description:As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines, working with cutting-edge tools like Python, DBT, and Databricks. Your primary focus will be transforming raw data into...

  • Senior Engineer

    3 months ago

    india NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Senior Engineer

    2 days ago

    india NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Data Engineer

    3 weeks ago

    India Insight Global Full time

    Insight Global is looking for a Senior Data Engineer to work remotely in India. Candidates will work IST hours. Candidates will be a part of the clients data modernization project, transitioning from on-premises to cloud infrastructure (Azure). They will utilize programming skills in SQL, PySpark, and Python to support data transformation and migration...

  • Senior Data Engineer

    3 weeks ago

    India Insight Global Full time

    Insight Global is looking for a Senior Data Engineer to work remotely in India. Candidates will work IST hours. Candidates will be a part of the clients data modernization project, transitioning from on-premises to cloud infrastructure (Azure). They will utilize programming skills in SQL, PySpark, and Python to support data transformation and migration...

  • Senior Data Engineer

    3 hours ago

    India Insight Global Full time

    A large leading global provider of advanced analytics, technology solutions, and clinical research services to the life sciences industry is seeking a Senior Data Engineer to join their team based out of King of Prussia, PA. This individual will be focused on a digital marketing data product project which is a central hub for all digital data that this...

  • Senior Data Engineer

    1 month ago

    India System Soft Technologies Full time

    Senior Data EngineerJob descriptionAzure ADF, DatabricksData Engineer with Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformationsSound Knowledge on - Azure Data Bricks, Azure Data Lake.Sound knowledge in Data Bricks & Logic AppsDelta Lake, Azure SQL and Azure blob storage, Azure...

  • Senior Data Engineer

    2 weeks ago

    India Programmers.io Full time

    Programmers.io is looking for Senior Data EngineerJob Description: Job Title: Azure Data Engineer Shift Timings: 12 PM - 9 PM Location: Jaipur Experience required: 5 to 10 years Key Responsibilities:Design and develop scalable data pipelines using Databricks and Azure Data Factory.Implement and optimize data warehousing solutions and Synapse Analytics...

  • Senior Data Engineer

    2 days ago

    india Programmers.io Full time

    Programmers.io is looking for Senior Data Engineer Job Description: Job Title: Azure Data Engineer Shift Timings: 12 PM - 9 PM Location: Jaipur Experience required: 5 to 10 years Key Responsibilities: Design and develop scalable data pipelines using Databricks and Azure Data Factory. Implement and optimize data warehousing solutions and...

Senior Data Engineer

4 months ago

india Koantek Full time

About the Company:


Koantek is a consulting firm that provides customized solutions to tackle the most challenging business

problems through data and machine learning. With decades of combined experience, Koantek uses

extensive industry-specific research and deep technical knowledge to guide companies on how to

modernize their business, make better decisions, and embrace technology that challenges the status

quo. We operate in the BI/AI tech space with emphasis on Data engineering, analytics, architecture, and

security. Our projected growth for the year in terms of people numbers is 300 for 2023. Most of the

expansion will happen in India and we are looking to engage top talent here.


Job Description:


The Senior Data Engineer with Databricks experience at Koantek will use comprehensive modern data

engineer techniques and methods with Advanced Analytics to support business decisions for our clients.

You will help design and build data pipelines, data streams, reporting tools, information dashboards, data

service APIs, data generators, and other end-user information portals and insight tools. You will be a

critical part of the data supply chain, ensuring that stakeholders can access and manipulate data for

routine and ad hoc analysis to drive business outcomes using Advanced Analytics

Role: Senior Data Engineer (cloud platform: AWS / GCP)


Job Requirements:


* Strong experience as a data engineer (Databricks preferred)

* Expert proficiency in Spark Scala,Advanced SQL & Python (mandate), and PySpark is a plus *

Must have data migration experience from on prem to cloud

* Hands-on experience in Kinesis to process & analyze Streaming data, and cloud DynamoDB *

In depth understanding of cloud, data lake, and analytics solutions.

* Expert level hands-on development in designing and developing applications on Databricks,

Databricks Workflows, cloud Managed Airflow, and Apache Airflow is required.

* Extensive hands-on experience implementing data migration and data processing using Cloud

services: VPC/SG, EC2, S3, AutoScaling, CloudFormation, LakeFormation, DMS, Kinesis, Kafka,

Nifi, CDC processing, Amazon S3, EMR, Redshift, Athena, Snowflake, RDS, Aurora, Neptune,

DynamoDB, Cloudtrail, CloudWatch, Docker, Lambda, Spark, Glue, SageMaker, AI/ML, API GW,

etc.

* Hands-on experience with the Technology stack available in the industry for data management,

data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map

Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc.

* Knowledge of different programming and scripting languages

* Good working knowledge of code versioning tools (such as Git, Bitbucket or SVN) * Hands-on

experience in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair

* Experience preparing data for use in SageMaker and Databricks.

* Demonstrated experience preparing data, automating and building data pipelines for AI Use

Cases (text, voice, image, IoT data etc....).

* Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark

Scala, Spark SQL/PySpark

* Knowledge of any cloud DevOps processes like CI/CD as well as Agile tools and processes

including Git, Jenkins, Jira, and Confluence

* Strong understanding of Data Modeling and defining conceptual logical and physical data

models.


Responsibilities:


* Work closely with team members to lead and drive enterprise solutions, advising on key decision

points on trade-offs, best practices, and risk mitigation

* Manage data related requests, analyze issues, and provide efficient resolution. Design all

program specifications and perform required tests

* Design and Develop data Ingestion using Glue, Any cloud Managed Airflow, Apache Airflow and

processing layer using Databricks.

* Work with the SMEs to implement data strategies and build data flows and prepare codes for all

modules according to required specification.

* Monitor all production issues and inquiries and provide efficient resolution. * Evaluate all

functional requirements, map documents, and troubleshoot all development processes

* Document all technical specifications associate project deliverables and design all test cases

to provide support to all systems and perform unit tests.


Must have skills: AWS / GCP, Spark, Python, SQL, Pyspark (Databricks good to have)

Location: PAN India

Work Mode: Remote