Data Software Engineer

4 weeks ago


Bengaluru Karnataka India, Karnataka Alp Consulting Ltd. Full time

Data Software Engineer - Spark, Python, (AWS ,Kafka or Azure Databricks or GCP)

Job Description:

  1. 5-12 Years of in Big Data & Data related technology experience
  2. Expert level understanding of distributed computing principles
  3. Expert level knowledge and experience in Apache Spark
  4. Hands on programming with Python
  5. Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop
  6. Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming
  7. Experience with messaging systems, such as Kafka or RabbitMQ
  8. Good understanding of Big Data querying tools, such as Hive, and Impala
  9. Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files
  10. Good understanding of SQL queries, joins, stored procedures, relational schemas
  11. Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  12. Knowledge of ETL techniques and frameworks
  13. Performance tuning of Spark Jobs
  14. Experience with native Cloud data services AWS or AZURE Databricks,GCP.
  15. Ability to lead a team efficiently
  16. Experience with designing and implementing Big data solutions
  17. Practitioner of AGILE methodology


  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India, Karnataka Guidewire Software Full time

    Responsibilities:Design and Development:Architect, design, and develop robust, scalable, and efficient data pipelines.Design and manage platform solutions to support data engineering needs to ensure seamless integration and performance.Write clean, efficient, and maintainable code.Leadership and Collaboration:Lead and mentor a team of Data engineers,...

  • Senior Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    Mandatory* Experience building data pipelines* Highly proficient in python, Data frames* Experience with AWS Lambda, Events (SQS), API calls, Kinesis, DynamoDB* Highly proficient in SQL Query* Snowflake or experience with similar analytics database* Experience extracting data from SQL and NoSQL databases. * Experience with CI/CD pipeline to release the code...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    Hi,We are looking for Data Engineer- Exp: 5+ yrs1. Strong SQL Knowledge 2. Experience in Snowflake - SnowSQL,Snowpipe,Streams,Tasks,Procedures,TImeTravel etc 3. Good understanding of Datawarehouse concepts 4. Cloud Platform - AWS Knowledge 5. Scripting - Python/Javascript

  • Data Engineer

    4 days ago


    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka SpireNSavvy Software Solutions Pvt Ltd Full time

    We are looking for a skilled and motivated AWS Data Engineer with 3–4 years of hands-on experience in modern data and application development environments. The ideal candidate will have strong technical expertise in Python, MongoDB, Snowflake, DBT, and Airflow—with a focus on designing, developing, and optimizing scalable data pipelines and integrated...


  • Bengaluru, Karnataka, India Performance Engineer Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Responsibilities:Web and Mobile Front-End Development:Build responsive, performant, and feature-rich web applications using Angular (latest version), JavaScript, TypeScript, and RxJS for handling asynchronous operations and complex data streams.State Management with NgRx:Utilize NgRx for managing state in Angular applications. Design scalable and efficient...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India, Karnataka Digitrix Software LLP Full time

    Experience: 5 -10 yearsLocation: Bangalore / Pune / Kolkata / Hyderabad / Gurugram (Hybrid) Notice Period: Immediate Joiners OnlyMust Have : PostgreSQL (Advanced), Python (Intermediate level)Concepts : ETL Process, Data modellingCI/CD - Deployment Process, GitlabCloud experience - AWS S3 / Azure BLOB, ADLSGood to Have : Orchestration (Airflow) / Autosys...


  • Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    Hi,We are looking for Snowflake Data Engineer- Immediate JoinerExp: 5+ yrs1. Strong SQL Knowledge2. Experience in Snowflake - SnowSQL,Snowpipe,Streams,Tasks,Procedures,TImeTravel etc3. Good understanding of Datawarehouse concepts4. Cloud Platform - AWS Knowledge5. Scripting - Python/Javascript

  • Software Engineer

    2 weeks ago


    Bengaluru, Karnataka, India, Karnataka Sonata Software Full time

    J.D- .Net Fullstack DeveloperJob Title: Full Stack Developer – .NET Core, RXJS, Angular 14+ & Azure APP ServiceLocation: Chennai/Bangalore/HyderabadJob Type: HybridExperience Level: 3–8 YearsJob Summary:We are seeking a skilled and proactive Full Stack Developer with expertise in .NET Core, Angular, and Web API, to join our growing team. The ideal...

  • Data Engineer

    4 days ago


    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...