Lead Data Engineer

About Indxx: Indxx seeks to redefine the global indexing space. We create indices which are used to create FinancialProducts and Benchmarks. Founded in 2005 and with offices in New York and New Delhi, the firm focuseson Index Development, Index Calculation, Analytics & Research and combines these services in a holistic,customized approach that is unique to the industry and provides maximum benefits to our clients. In2009, we launched our first indices that serve as the underlying benchmarks for ETFs. Since then, we havesuccessfully developed and licensed a multitude of indices to clients globally, offer real-time and end ofday calculation services, and provide many fund managers with tailor-made research and analytics.Location: GurgaonRole:We are looking for a Lead Data Engineer to join our team and drive the development of data warehouse,data pipelines, ETL processes, and data integrations to support our data analytics and businessintelligence needs. In this role, you will design, build, and maintain efficient and reliable data pipelines,transforming raw data into actionable insights. You will work closely with developers, analysts, andbusiness stakeholders to optimize data flow and ensure data accessibility across the organization.Responsibilities:Technical Skills Required:- Strong proficiency in writing & optimizing large, complicated SQL queries, and SQL Server StoredProcedures.- Develop, optimize, and maintain scalable data pipelines and ETL processes to support ongoingdata analytics, and reporting.- Build and manage data infrastructure, ensuring the efficient storage, transformation, andretrieval of structured and unstructured data from multiple sources.- Collaborate with developers, analysts, and other engineers to ensure data accuracy, quality, andavailability for analysis and reporting.- Design, implement, and maintain data architecture, databases, and warehouses, supportingbusiness intelligence and advanced analytics requirements.- Monitor and troubleshoot data pipeline performance and resolve any issues to ensure dataprocessing efficiency and reliability.- Develop and enforce data quality standards, data governance policies, and data securityprotocols across the data lifecycle.- Leverage cloud platforms (AWS, GCP, Azure) for data engineering tasks, implementing bestpractices for cloud-native data storage, processing, and pipeline automation.Ideally, you should have:- Min. 5-8 years of experience working and building Data-Intensive Applications.- Proficiency in programming languages such as Python, or Scala for data processing andmanipulation.- Experience with data warehousing solutions like Snowflake, Redshift, or BigQuery.- Familiarity with cloud platforms (AWS, GCP, or Azure) and their respective data services (e.G., S3,EMR, BigQuery).- Strong understanding of relational and non-relational databases, including MySQL, PostgreSQL,MongoDB, and Cassandra.- Solid understanding of data modelling, data warehousing concepts, and data governance bestpractices.- Handling common database requirements such as upgrades, backup, recovery, migration, etc.- Experience with data pipeline tools such as Apache Airflow, DBT for ETL orchestration andautomation would be an added advantage.- Familiarity with CI/CD tools and practices for data engineering.- Experience with data quality frameworks, monitoring, and validation techniques.Benefits:- Work on a ground-breaking FinTech product innovation with a global impact- Opportunity to work with an open-minded, experienced, and talented cross-functional and cross-cultural teams.- Collaboration with experienced management and an incredible network of board members andinvestors