Senior Software Engineer

3 weeks ago

Ballari, India BrightEdge Full time

Senior Software Engineer, Remote

The Software Engineer, Data Ingestion will be a critical individual contributor responsible for designing collection strategies, developing, and maintaining robust and scalable data pipelines. This role is at the heart of our data ecosystem, deliver new analytical software solution to access timely, accurate, and complete data for insights, products, and operational efficiency.


Key Responsibilities:

  • Design, develop, and maintain high-performance, fault-tolerant data ingestion pipelines using Python.
  • Integrate with diverse data sources (databases, APIs, streaming platforms, cloud storage, etc.).
  • Implement data transformation and cleansing logic during ingestion to ensure data quality.
  • Monitor and troubleshoot data ingestion pipelines, identifying and resolving issues promptly.
  • Collaborate with database engineers to optimize data models for fast consumption.
  • Evaluate and propose new technologies or frameworks to improve ingestion efficiency and reliability.
  • Develop and implement self-healing mechanisms for data pipelines to ensure continuity.
  • Define and uphold SLAs and SLOs for data freshness, completeness, and availability.
  • Participate in on-call rotation as needed for critical data pipeline issues


Key Skills:

  • 5+ years of experience, ideally with background in Computer Science, working in software product companies.
  • Extensive Python Expertise: Extensive experience in developing robust, production-grade applications with Python.
  • Data Collection & Integration: Proven experience collecting data from various sources (REST APIs, OAuth, GraphQL, Kafka, S3, SFTP, etc.).
  • Distributed Systems & Scalability: Strong understanding of distributed systems concepts, designing for scale, performance optimization, and fault tolerance.
  • Cloud Platforms: Experience with major cloud providers (AWS or GCP) and their data-related services (e.g., S3, EC2, Lambda, SQS, Kafka, Cloud Storage, GKE).
  • Database Fundamentals: Solid understanding of relational databases (SQL, schema design, indexing, query optimization). OLAP database experience is a plus (Hadoop)
  • Monitoring & Alerting: Experience with monitoring tools (e.g., Prometheus, Grafana) and setting up effective alerts.
  • Version Control: Proficiency with Git.
  • Containerization (Plus): Experience with Docker and Kubernetes.
  • Streaming Technologies (Plus): Experience with real-time data processing using Kafka, Flink, Spark Streaming.

  • Senior Software Engineer

    2 weeks ago

    Ballari, India Lucidity Full time

    Role : Senior Software Engineer - Backend Location : Bangalore/Remote Experience : 4-7 years About us Lucidity is a rapidly growing company with a first of its kind and impactful product in the cloud storage. Joining Lucidity offers the opportunity to work on cutting-edge technology, solve real-world problems for major enterprises, and be part of a company...

  • Senior data engineer

    2 days ago

    Ballari, India HealthyMe AI Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Java Software Engineer

    7 days ago

    Ballari, India ACL Digital Full time

    Title: Java Developer (Contract Role)Location: Remote or Bengaluru, India (Onsite)Duration: 12 MonthsRole SummaryFocus on scalable APIs, workflow frameworks, and automation platforms that improve customer and agent experiences.Acts as a strong individual contributor while mentoring junior engineers, leading key projects, and ensuring reliability,...

  • IAM Senior Engineer

    4 weeks ago

    Ballari, India ATC Full time

    The IAM Senior Engineer will be responsible for the service design, build, and documentation of all key elements of Customer Identity and Access Management (CIAM) and Certificate Lifecycle Management supporting infrastructure and services. This role is a critical part of the overall authentication and authorization infrastructure.The IAM Senior Engineer...

  • Iam senior engineer – cyberark

    3 weeks ago

    Ballari, India Perfict Full time

    Job DescriptionThe IAM Senior Engineer will be responsible for the service design, build, deploy, and support of key elements of the Privileged Access Management (PAM) platform built leveraging the Cyber Ark Cloud PAM solution supporting infrastructure, servers, services, and privilege accounts that are part of the overall IT ecosystem.It is incumbent upon...

  • Senior Devops Engineer

    3 weeks ago

    Ballari, India Sphera Full time

    Sphera is a leading global provider of enterprise software and services that enables companies to manage and optimize their environmental, health, safety and sustainability. Our mission is to create a safer, more sustainable and productive world.Sphera is a portfolio company of Blackstone, a U.S.-based alternative asset investment company that focuses on...

  • Senior Generative AI Engineer

    3 weeks ago

    Ballari, India Ampstek Full time

    Title: Senior Generative AI Engineer (Databricks,Data Lake)Location: 100% RemoteJob Type: FulltimeKey Responsibilities• Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.• Architect and optimize data pipelines and workflows in Databricks for large-scale AI training and inference.• Manage and...

  • Engineering Manager

    7 days ago

    Ballari, India Matrimony.com Limited Full time

    General Manager - TechnologyWe are looking for an General Manager - Technology for new and emerging product lines at Matrimony.com. For this role, you will collaborate with a cross-functional team, including senior leaders, product managers, developers, quality analysts, server administrators and security engineers to establish a robust product engineering...

  • Data engineer

    6 days ago

    Ballari, India Insight Global Full time

    Job DescriptionInsight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion. You will be assisting the Data and Analytics team on one of the company's largest game titles set to launch this fall. Your day-to-day will be...

  • Senior ION Marketview Consultant

    7 days ago

    Ballari, India Quanteam UK Full time

    Job: Senior ION ConsultantLocation: Bangalore, IndiaHybrid working Employment type: B2B long-term contract engagementPay: £200 - £350 daily rateOverviewThis role is an exciting opportunity for a hands-on ION MarketView Platform Specialist. ION is a key component of our eTrading platform, providing pricing and trading integration for mainly D2C and to a...