Sr Software Engineer II- Data Engineering and Platform

3 days ago


Bengaluru, Karnataka, India LG Ad Solutions Full time
LG Ad Solutions

LG Ad Solutions is a global leader in connected TV (CTV) and cross-screen advertising. We pride ourselves on delivering state-of-the-art advertising solutions that integrate seamlessly with today's ever-evolving digital media landscape.

The Opportunity:

We are seeking a highly skilled and experienced developer to join our team in the role of Senior Software Engineer II – Data Engineering & Platform. This pivotal role focuses on providing technical vision and leadership for a major business component, managing end-to-end processes that operate at a high scale, processing several petabytes of data daily. The ideal candidate will have a robust background in data engineering, coupled with a proven track record in technical leadership. You will collaborate with cross-functional teams to drive technical innovation and deliver robust, scalable solutions that meet our business needs.

Responsibilities:

- Architect and Implement Scalable Data Solutions: Design, develop, and deploy comprehensive data solutions encompassing ETL pipelines, data warehousing, data architecture, data cataloguing, and data delivery mechanisms. Ensure these solutions are scalable, reliable, and maintainable to support evolving business needs.
- Lead Data Platform Strategy: Develop and execute the strategic vision for the data platform, ensuring alignment with organizational objectives. Oversee the architecture and management of data systems to support efficient data storage, processing, and utilization.
- Collaborate Cross-Functionally: Work closely with product managers, engineering teams, data scientists, and other stakeholders to design and implement effective data integration and hand-off mechanisms. Facilitate seamless data flow and accessibility across various systems and teams.
- Optimize Performance and Scalability: Identify and address performance bottlenecks within the data platform. Implement strategies to enhance system performance, scalability, and reliability, ensuring the infrastructure can handle large-scale data processing efficiently.
- Oversee Data Governance and Quality: Implement and maintain data governance frameworks to ensure data quality, accuracy, consistency, and security. Establish policies and procedures for data management, ensuring compliance with regulatory requirements and industry best practices.
- Mentor and Lead Engineering Teams: Provide technical leadership and mentorship to data engineers and other team members. Foster a culture of innovation, ownership, and continuous learning within the team, guiding them through complex technical challenges and project deliveries.
- Conduct Code and Architecture Reviews: Lead code and architecture reviews to maintain high standards of code quality and system design. Provide constructive feedback and ensure adherence to best practices and organizational standards.
- Stay Abreast of Industry Trends: Keep up-to-date with emerging technologies, tools, and methodologies in data engineering and platform development. Evaluate and recommend new solutions to enhance the data platform's capabilities and efficiency.

Requirements:

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Over 5 years of software development experience, with at least 2 years in a technical leadership role overseeing data engineering or data platform teams.
- Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka.
- Experience with programming languages such as Scala and Python for developing robust data pipelines.
- In-depth knowledge of both relational and non-relational databases, with the ability to design and optimize complex queries.
- Hands-on experience with data visualization tools and techniques to present data insights effectively.
- Proficiency in developing and maintaining CI/CD pipelines using tools like Jenkins and GitHub Actions.
- Strong experience in writing and maintaining unit, integration, and end-to-end tests to ensure data pipeline reliability and accuracy.
- Excellent problem-solving abilities with a keen attention to detail, capable of diagnosing and resolving complex technical issues.
- Strong communication skills, with the ability to convey complex technical concepts to diverse audiences.
- Proven ability to collaborate cross-functionally with product managers, data scientists, and other engineering teams to deliver cohesive data solutions.
- Familiarity with data governance and security practices to ensure compliance and data integrity.

Preferred:

- Experience with Infrastructure as Code (IaC) tools such as Pulumi and Terraform for managing cloud resources.
- Prior experience working with Databricks and AWS cloud services.
- Experience with Agile development methodologies and leading Agile teams.
- Experience in working with Distributed Graph Databases.

  • Bengaluru, Karnataka, India Microsoft Full time US$ 1,50,000 - US$ 2,00,000 per year

    Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Microsoft's Azure Data engineering team is leading the transformation of analytics in the...

  • Data Engineer II

    3 weeks ago


    Bengaluru, Karnataka, India Dotdash Meredith Full time

    Job DescriptionJob TitleData Engineer IIJob DescriptionAs a Data Engineer II, you will be responsible for designing, implementing, and maintaining data infrastructure that supports data science activities, including machine learning (ML) projects. You will work closely with data scientists, other data engineers, and cloud infrastructure teams in both...


  • Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 268395NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Role...

  • Software Engineer II

    4 weeks ago


    Bengaluru, Karnataka, India Uber Full time

    About The Role. Uber's Commerce Platform Engineering group is vital for maintaining and enhancing the infrastructure that enables all Uber lines of business to conduct transactions. As a central and mission-critical system, all commerce in and out of Uber flows through these systems, demanding strict 4 9's availability. This is one of our largest scalable...


  • Bengaluru, Karnataka, India Microsoft Full time US$ 1,50,000 - US$ 2,00,000 per year

    Microsoft RTB platform is transitioning to a hybrid environment of MPLS VPN based Global On-Prem Network and Cloud Networking. We have an MPLS traffic engineered global backbone with 100 Gigabit private connections between our On-Prem data centers and cloud network. We collaborate across multiple divisions of Microsoft to develop and implement unique network...

  • Sr Software Engineer

    4 weeks ago


    Bengaluru, Karnataka, India A79 Full time

    About A79.aiA79.ai is a VC-funded innovator building an agentic AI platform for the enterprise especially biopharma and life sciences industries. Our enterprise-grade platform enables rapid deployment of complex AI agent workflows that continuously learn, adapt, and evolve — delivering measurable ROI for pharmaceutical and biotech clients.Position...


  • Bengaluru, Karnataka, India Microsoft Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure...

  • Sr Frontend Engineer

    2 weeks ago


    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Frontend Engineer to join our team in Bangalore, Karntaka (IN-KA), India (IN).Who we are:NTT DATA America's strives...


  • Bengaluru, Karnataka, India Abnormal Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    The OpportunityAbnormal AI is revolutionizing cybersecurity by leveraging AI-native technologies to combat modern cyber threats. We're building a team of top-tier engineers who are excited to use Generative AI tools like Cursor, GitHub Copilot, and Claude to redefine how software is built—faster, smarter, and more efficient.We are seeking a highly skilled...


  • Bengaluru, Karnataka, India Abnormal Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    The OpportunityAbnormal AI is revolutionizing cybersecurity by leveraging AI-native technologies to combat modern cyber threats. We're building a team of top-tier engineers who are excited to use Generative AI tools like Cursor, GitHub Copilot, and Claude to redefine how software is built—faster, smarter, and more efficient.We are seeking a highly skilled...