Software Data Engineer

1 day ago

Bengaluru Bangalore Chennai, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000
Job Description

We are seeking a skilled professional to develop and maintain data engineering processes, Python applications, and services. The ideal candidate will have a strong understanding of software development, data analysis, and cloud computing platforms.

Key Responsibilities
  • Develop and maintain data engineering processes and Python applications
  • Perform data analysis validations on data process migrations
  • Troubleshoot and debug code
  • Deploy applications to production
  • Collaborate with DevOps teams to ensure smooth application operations
Required Skills and Qualifications

The successful candidate will possess the following skills and qualifications:

  • Proficiency in designing, creating, deploying, and sustaining software solutions on a large scale
  • Experience with implementing application architectural patterns, including MVC, Microservices, and Event-driven architectures
  • Knowledge of CI/CD tools such as Azure DevOps, Jenkins, GoCD, etc.
  • Experience with deploying and managing software on public cloud platforms like AWS
  • Collaboration within an Agile framework, preferably following Scrum methodologies
  • Proficiency in managing and deploying applications using container orchestration tools, specifically ECS (Elastic Container Service)
  • Good working knowledge on Python modules like Pandas, Numpy, mutlithreading, requests, etc
  • Possess a solid understanding of version control systems, with a particular focus on GIT
  • Proficiency with SQL
Benefits

The ideal candidate will also have the following benefits:

  • Proficient in managing diverse data stores, including Snowflake, Elasticsearch, MySQL, and Oracle
  • Well-versed in developing Snowflake procedures, tasks, and other Snowflake components
  • Experienced in working with message brokers such as AWS SQS and AWS SNS
  • Proficient in utilizing batch or stream processing systems, including Apache Spark and AWS Glue
  • Familiarity with scheduling tools like Apache Airflow and Perfect
  • Skilled in developing and working with Restful APIs
  • Hands-on experience with API tools like Swagger, Postman, and Assertible
  • Advocate of Test-Driven Development (TDD) and Behaviour-Driven Development (BDD)
  • Extensive hands-on experience with testing tools like Selenium and Cucumber, with expertise in seamlessly integrating them into CI/CD pipelines
Others

The successful candidate will be able to thrive in a high-pressure situation and deliver results within tight time constraints. They will also have demonstrated passion for technology and eagerness to contribute to a collaborative team environment.

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Quantrail Data Full time

    Location: Chennai, India (On-site)Duration: 3 monthsStipend: UnpaidEligibility: 2025 graduates onlyConversion: Opportunity for a full-time role based on performance Note: Please apply only if you are serious about joining us. This is a learning-focused internship, and we expect interns to be committed to upskilling themselves and contributing to real-world...

  • Associate Engineer-Software

    4 weeks ago

    Bengaluru, Karnataka, India SLK Software Full time

    Job DescriptionSLK Software Services Private Limited is looking for Associate Engineer-Software to join our dynamic team and embark on a rewarding career journey1. Developing and directing software system validation and testing methods2. Directing our software programming initiatives3. Overseeing the development of documentation4. Working closely with...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key Responsibilities:•  ...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Axiom Software Solutions Limited Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title: Data Engineer - TCSCompany: Axiom Software Solutions LimitedType: PermanentLocation: United KingdomJob Description:Axiom Software Solutions Limited is seeking a skilled Data Engineer to join our team in a permanent capacity. The ideal candidate will have significant experience in building scalable data pipelines and contributing to data management...

  • Data Engineering Specialist

    5 days ago

    Chennai, Bengaluru / Bangalore, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Ops Software EngineerWe are seeking a skilled software engineer to help develop our Cloud Data Hub, an AWS-based data platform for managing petabytes of enterprise data.This role involves building end-to-end platform features that empower customers to design, deploy, and monitor their own data pipelines.Key Responsibilities:Design, develop,...

  • Software Engineer III

    2 weeks ago

    Bengaluru, Karnataka, India Guidewire Software Full time US$ 1,50,000 - US$ 2,00,000 per year

    SummaryAbout Guidewire Guidewire is the platform P&C insurers trust to engage, innovate, and grow efficiently. We combine digital, core, analytics, and AI to deliver our platform as a cloud service. More than 540+ insurers in 40 countries, from new ventures to the largest and most complex in the world, run on Guidewire. As a partner to our customers, we...

  • Software Engineer

    1 week ago

    Bangalore, India NetApp, Inc. Full time US$ 80,000 - US$ 1,50,000 per year

    Job Summary As a Software Engineer you will work as part of a team of skilled engineers accountable for participating in the entire lifecycle of the products including design, development, maintenance & testing. As part of this function, you will build a deep working knowledge of core NetApp technologies, cloud technologies, storage systems and more. You...

  • Software QA Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time

    Job DescriptionMake an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion its a place where you can grow, belong and thrive.Your day at NTT DATAThe...

  • Career Opportunity

    10 hours ago

    Chennai, Tamil Nadu, India beBeeData Engineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Summary">This role is responsible for participating as an individual contributor in project teams, troubleshooting operational issues, and providing technical solutions to operational problems.The ideal candidate will have experience with Python, SQL, and Bash Scripting, as well as knowledge of data pipeline fundamentals and general understanding of...

  • Senior Data Engineer Leader

    5 hours ago

    Bengaluru / Bangalore, Pune, Chennai, India beBeeDataEngineering Full time ₹ 25,00,000 - ₹ 50,00,000

    Senior Data Engineering LeadThis role involves leading the design, development and implementation of scalable data processing systems using Big Data technologies. The ideal candidate should have hands-on experience with distributed computing frameworks such as Hadoop, Spark, Flink or similar platforms.Key Responsibilities:Develop and maintain a data...