Senior Software Engineer

5 hours ago

Ballari, India BrightEdge Full time

Senior Software Engineer, Remote

The Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable data pipelines. This role is at the heart of our data ecosystem, deliver new analytical software solution to access timely, accurate, and complete data for insights, products, and operational efficiency.


Key Responsibilities:

  • Design, develop, and maintain high-performance, fault-tolerant data ingestion pipelines using Python.
  • Integrate with diverse data sources (databases, APIs, streaming platforms, cloud storage, etc.).
  • Implement data transformation and cleansing logic during ingestion to ensure data quality.
  • Monitor and troubleshoot data ingestion pipelines, identifying and resolving issues promptly.
  • Collaborate with database engineers to optimize data models for fast consumption.
  • Evaluate and propose new technologies or frameworks to improve ingestion efficiency and reliability.
  • Develop and implement self-healing mechanisms for data pipelines to ensure continuity.
  • Define and uphold SLAs and SLOs for data freshness, completeness, and availability.
  • Participate in on-call rotation as needed for critical data pipeline issues


Key Skills:

  • 5+ years of experience, ideally with background in Computer Science, working in software product companies.
  • Extensive Python Expertise: Extensive experience in developing robust, production-grade applications with Python.
  • Data Collection & Integration: Proven experience collecting data from various sources (REST APIs, OAuth, GraphQL, Kafka, S3, SFTP, etc.).
  • Distributed Systems & Scalability: Strong understanding of distributed systems concepts, designing for scale, performance optimization, and fault tolerance.
  • Cloud Platforms: Experience with major cloud providers (AWS or GCP) and their data-related services (e.g., S3, EC2, Lambda, SQS, Kafka, Cloud Storage, GKE).
  • Database Fundamentals: Solid understanding of relational databases (SQL, schema design, indexing, query optimization). OLAP database experience is a plus (Hadoop)
  • Monitoring & Alerting: Experience with monitoring tools (e.g., Prometheus, Grafana) and setting up effective alerts.
  • Version Control: Proficiency with Git.
  • Containerization (Plus): Experience with Docker and Kubernetes.
  • Streaming Technologies (Plus): Experience with real-time data processing using Kafka, Flink, Spark Streaming.

  • Senior Data Engineer

    2 weeks ago

    Ballari, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • IAM Senior Engineer

    5 days ago

    Ballari, India ATC Full time

    The IAM Senior Engineer will be responsible for the service design, build, and documentation of all key elements of Customer Identity and Access Management (CIAM) and Certificate Lifecycle Management supporting infrastructure and services. This role is a critical part of the overall authentication and authorization infrastructure.The IAM Senior Engineer...

  • Senior quality engineer

    2 weeks ago

    Ballari, India VeriPark Full time

    We enable financial institutions to become digital leaders. As a global professional team, we work with best clients for great and exciting projects, in an environment where we learn amazing things every day. Each code, each voice, each contribution, each challenge, each success is celebrated here. We welcome candidates who share our values, have the...

  • Senior Devops Engineer

    5 hours ago

    Ballari, India Sphera Full time

    Sphera is a leading global provider of enterprise software and services that enables companies to manage and optimize their environmental, health, safety and sustainability. Our mission is to create a safer, more sustainable and productive world.Sphera is a portfolio company of Blackstone, a U.S.-based alternative asset investment company that focuses on...

  • Machine learning engineer

    2 weeks ago

    Ballari, India Genista Biosciences Full time

    Machine Learning Engineer (Remote)Company: Genista Biosciences (San Jose, CA – US-based Biotech Startup)Genista Biosciences is a fast-growing biotech company dedicated to improving public health and food safety through robotics, software, and advanced technology. We’re looking for a Machine Learning Engineer to design, build, and deploy scalable ML...

  • Senior Generative AI Engineer

    5 hours ago

    Ballari, India Ampstek Full time

    Title: Senior Generative AI Engineer (Databricks,Data Lake)Location: 100% RemoteJob Type: FulltimeKey Responsibilities• Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.• Architect and optimize data pipelines and workflows in Databricks for large-scale AI training and inference.• Manage and...

  • Manager- Sr Design Engineer

    5 days ago

    Ballari, India Encon Systems Full time

    Company DescriptionEstablished in 2008, Encon Systems is a trusted leader in solving automation challenges in the manufacturing industry. With expertise in factory automation, mechatronics, mechanical design, robotics, and IIoT solutions, our team tackles complex automation challenges across various industry verticals. We are dedicated to providing...

  • Full Stack Engineer

    1 week ago

    Ballari, India Cybrenium Full time

    Company Description We suggest you enter details here Role Description This is a full-time on-site role for a Full Stack Engineer located in Ballari. The Full Stack Engineer will be responsible for developing and maintaining both front-end and back-end components of web applications. Daily tasks will include writing clean, scalable code, troubleshooting and...

  • Site Engineer

    1 week ago

    Ballari, India MYSCAAI Full time

    Role Overview:We are seeking a skilled and detail-oriented Site Engineer to oversee construction activities, ensure project timelines are met, and maintain quality standards. The ideal candidate has strong technical knowledge, excellent problem-solving skills, and a hands-on approach to managing construction sites. Key Responsibilities: Supervise and...

  • Sr. QA Test Engineer Automation

    7 days ago

    Ballari, India Sycamore Informatics Inc. Full time

    RoleTester role performing automation testing activities.DesignationSr. QA Test EngineerExperience (in years)7-11 yearsEducation Masters/Bachelor’s degree, preferably in Computer Science, Information science, Physics, Math or any other related discipline.Essential skillsExperience with testing management tools like Jira, HP/OpenText ALM, IBM Rational,...