Senior Data Engineer

4 weeks ago


MumbaiChennai, IN Cyber Sphere LLC Full time

Senior Data Engineer

Onsite : Mumbai/Chennai

About the Role :

- This role is more focused on Pyspark with Cloud developer.

About the Responsibilities :

- This position provides direct input to project plans, schedules, and follows software methodologies and best practices in the development of cross-functional software products under a micro-services styled architecture.

- Developer performs software design and development requiring interaction with system architects and other development team members; and the interaction with business analysts and/or end-users/customers to translate their requests into solutions.

About the Requirements :

Overall Work Experience - 8+ Skill Set :


- Apache spark, Python, Databricks, SQL/NoSQL-Knowledge

- BS Engineering/Computer Science or equivalent experience required.

- Strong analytical skills, Communication, Problem Solving skills.

- Expertise on SQL, Unix.

- Strong hold on Data Manipulation Language, ETL concepts.

- Must have adequate knowledge on - PreData processing, Facts and Dimension, Data Profiling, using any ETL tool or scripting languages- Talend, Informatica, IBM DataStage, Pentaho or using Bigdata concepts. If not used tool must have Python knowledge.

- Expertise in Cloud (prefer Azure), Pyspark.

- Prior experience on Cloud tools like - Data Bricks, Data Factory or equivalent AWS or Azure tools.

- Good Knowledge on PySpark with basic terraform knowledge.

- Expected knowledge of software development methodologies (e.g., Agile, Waterfall).

- Good Problem Solving and Requirement understanding skills as well as a positive attitude, ability, and desires to learn new processes and technologies.

- Successfully implement end to end development and help with Code Reviews, Best practices.

Good to have :

- Azure Knowledge (ref:hirist.tech)
  • Senior Data Engineer

    4 weeks ago


    Bangalore/Trivandrum/Thiruvananthapuram/Chennai/Pune, IN Arting Digital Full time

    Senior Data EngineerExperience : 6y+ Location : Trivandrum, Chennai, Pune, Bangalore Budget : 15 - 25 LPA Work Mode : On-SiteSkills : - Ataccama, Syndigo, Snowflake, Databricks- Requirements :- 6+ Years experience as a Data Engineer, who played a key/lead role in implementing one or two large data solutions- Programming experience in Scala or Python, SQL-...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Chennai/Madurai, IN Resourcetree Full time

    Job Description : As a Senior MDM Data Engineer with hands-on experience in Informatica Cloud MDM, you will be responsible for leading and executing end-to-end master data management (MDM) initiatives within our organization. Leveraging your deep technical expertise and practical experience, you will drive the design, implementation, and optimization of MDM...


  • Anywhere in India/Multiple Locations/Bangalore/Chennai, IN iMind Your Business Solutions Private Limited Full time

    We are hiring senior data engineers for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India (Bangalore and Chennai).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...


  • Hyderabad/Bangalore/Chennai/Vishakhapatnam/Vizag, IN Mouri Tech Ltd Full time

    Senior Cloud Data Engineer (AWS, Python, Pyspark) Job Title : Senior AWS Cloud Data EngineerWork Location : Hyderabad/Kolhapur/Bangalore/Chennai Experience : 6 to 9 yearsRequired Skills : Python, Pyspark, AWS services such as DMS, SAM, Glue, Redshift, Lamda S3 with Apache Airflow, CI/CD, :- Minimum of 6-9 Experience with the core AWS Services and setting up...

  • Decision Point

    4 weeks ago


    Chennai/Gurgaon/Gurugram, IN Decision Point Full time

    What would a typical day at your work be like?The Person will work as a Senior Data Engineer in Data Engineering team of Decision Point, Translating business and functional user requirements into functioning solutions. The incumbent for the position is expected to deliver but not limited to on following responsibilities :- Set up processes for data...

  • Senior Data Engineer

    4 weeks ago


    Hyderabad/Chennai/Pune/Mumbai/Gurgaon/Gurugram, IN Hub Work Full time

    We are looking for a data engineer who has experience in building data pipelines for large data platforms. This role will be working with a team building a large data platform catering to the needs of a wealth manager for their application and analytics needs. This role will be augmented with a customer of Intellect and other third parties in delivering...

  • Python Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Pune/Mumbai/Chennai, IN Swift Strategic Staff Solutions INC Full time

    Job Description :We are seeking a talented and experienced Python Data Engineer to join our data team and play a crucial role in building, maintaining, and optimizing data pipelines for our cloud-based data warehouse.Responsibilities :- Design, develop, and implement data pipelines for ingesting, transforming, and loading data into Snowflake using Python...

  • Senior Data Scientist

    4 weeks ago


    Gurgaon/Gurugram/Mumbai, IN Invokhr Full time

    Position: Senior Data ScientistDesired Experience: 8+ yearsYour team :You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients. You will collaboratively work with interdisciplinary scientists, IT and engineering professionals across the organization to solve critical problems and...

  • Data Engineer

    4 weeks ago


    Pune/Mumbai/Hyderabad/Chennai/Bangalore, IN RapidBraiins Full time

    Position Overview :As a Talend - Data Engineering Specialist, you will play a key role in designing, developing, and maintaining data pipelines using Talend, AWS, and SQL. You will work closely with cross-functional teams to gather requirements, design data solutions, and implement scalable and efficient ETL processes. Additionally, you will leverage your...


  • Bangalore/Delhi NCR/Chennai/Hyderabad/Mumbai, IN Grizmo Labs Full time

    Job Description : We are looking for : - 6-8 years of overall experience and 4 yrs or more into Data Science projects, ML Engineering and Modelling- Hands on experience with Python programming and managing the environment for python projects. - Implementation experience of algorithm categories like Classification, Regression, Parametric and Non-Parametric...

  • Senior Data Engineer

    4 weeks ago


    Bangalore/Hyderabad/Mumbai/Pune, IN MLOPS SOLUTIONS PRIVATE LIMITED Full time

    Job Description :Primary skillset :Experience working with distributed technology tools for developing Batch and Streaming pipelines using :- SQL, Spark, PySpark - Airflow - Spark with Scala .(optional)- Able to write code which is optimized for performance.- Experience in Cloud platform, e.g., AWS, GCP, Azure, etc.- Able to quickly pick up new programming...

  • Senior Data Engineer

    4 weeks ago


    Chennai/Bangalore/Hyderabad/Pune, IN Resourcetree Full time

    Job Description :Data engineering role requires creating and managing technological infrastructure of a data platform, be in- charge / involved in architecting, building, and managing data flows / pipelines and construct data storages (noSQL, SQL), tools to work with big data (Hadoop, Kafka), and integration tools to connect sources or other databases.Role...

  • Data Engineer

    4 weeks ago


    Mumbai/Chennai/Pune/Bangalore, IN Coders Brain Pvt Ltd Full time

    JD - Python and Snowflake- Experienced Data engineer(6+) responsible for developing, overseeing, organizing, storing, and analyzing data and data systems.- Responsible for Cloud migrations for data pipelines using AWS and Snowflake- Participate in all aspects of the software development lifecycle for AWS and Snowflake solutions, including planning,...

  • Data Engineer

    4 weeks ago


    Chennai/Mumbai/Pune, IN iMind Your Business Solutions Private Limited Full time

    Company Description :iMind Business Consulting Inc. is a strategy and talent consulting company headquartered in the US with offices in the UK, US and India. Role Description :This is a full-time hybrid role for one of our niche clients headquartered in San Francisco, US, with offices in India. Leaders in analytics and cloud applications, headquartered in...


  • Delhi NCR/Mumbai/Pune/Bangalore, IN Huquo Consulting Full time

    Job Description :Key Responsibilities & Skillsets : Common Skillsets :- 3+ years of experience in Data Engineering : SQL(MySQL preferred), DWH (Redshift or Snowflake), Python and associated data engineering jobs.- Good to have working experience on RESTful API frameworks (Flask/FastAPI)- Experience with AWS core technologies Lambda, S3, ECS(Fargate), IAM,...


  • Chennai/Madurai/Coimbatore, IN Optisol Business Solutions Full time

    Position : Data Engineer( Senior/Lead)Experience : 4-10 yrs.Locations : : Immediate -15 Days (Preferred)Required Candidate Profile :As a Data Engineer, you will be an integral part of our Data Engineering team supporting an event-driven server less data engineering pipeline on AWS cloud, responsible for assisting in the end-to-end analysis, development &...


  • Bangalore/Hyderabad/Chennai/Pune, IN Nilasu consulting Full time

    About the Role :We are searching for a talented and experienced Senior Data Scientist to join our team and play a key role in leveraging the power of machine learning (ML) and artificial intelligence (AI) to extract valuable insights from data. In this role, you will be responsible for the entire data science lifecycle, from data acquisition and wrangling to...

  • AWS Data Engineer

    4 weeks ago


    Pune/Chennai/Mumbai/Bangalore/Delhi NCR/Hyderabad, IN Change leaders Full time

    Job Description : AWS Glue + Python PysparkJob Overview :Candidate should be responsible for the configuration, administration, and optimization of the AWS Glue + Python Pyspark platform. This role involves ensuring the smooth operation of AWS Glue + Python Pyspark for data integration, transformation, and loading tasks in alignment with the...

  • Data Engineer

    22 hours ago


    Hyderabad/Chennai/Pune, IN Freelancer HR Full time

    Description :Job Description :- Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights- Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)- Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB,...

  • Data Engineer

    4 weeks ago


    Bangalore/Chennai/Hyderabad, IN Cortex Consulting Pvt. Ltd. Full time

    Responsibilities :- Design, construct, install, test, and maintain highly scalable data management systems.- Develop and implement ETL processes to collect, store, and process data from various sources.- Build and optimize data pipelines for efficient data ingestion and transformation.- Collaborate with data analysts and data scientists to understand data...