Description:
As a Senior Data Engineer, you will be at the forefront of transforming our data landscape, playing a crucial leadership role in shaping the future of our data-driven strategies. You will lead the design and implementation of enterprise-scale ELT/ETL pipelines using Informatica Cloud (IICS), ensuring data quality, security, and governance. You will mentor junior and mid-level engineers, providing technical guidance on best practices for Snowflake optimization, Informatica development, and secure data handling. Engage in exciting projects leveraging cutting-edge cloud and AI technologies, and work in a collaborative environment that encourages professional growth. Benefit from opportunities to expand your skills, influence strategic initiatives, and make a significant impact on our organization’s success.
Our Enterprise Data Technology organization at S&P Global is dedicated to driving innovation and ensuring the seamless integration and management of data across our commercial and marketing platforms. Our team values collaboration, continuous learning, and a commitment to excellence. We pride ourselves on our ability to adapt quickly to technological advancements and our focus on delivering high-quality data solutions to our clients.
Responsibilities
- Lead the architectural design of enterprise-scale data systems, ensuring robust, scalable, and efficient data architecture.
- Lead the design and deployment of ELT/ETL pipelines using Informatica Cloud (IICS) to integrate data from multiple sources into Snowflake, ensuring data quality and transformation standards.
- Architect and enforce data governance frameworks, including data lineage, metadata management, and compliance with regulatory requirements (GDPR, CCPA, SOC 2).
- Design, implement, and audit comprehensive RBAC and ABAC (Attribute-Based Access Control) security models within Snowflake to maintain secure data environments.
- Establish and maintain advanced data security protocols, including dynamic data masking, row-level security, and encryption at rest/in transit within Snowflake.
- Perform advanced SQL query optimization and performance tuning in Snowflake, leveraging features like Streams, Tasks, materialized views, clustering keys, and query profiling.
- Mentor junior and mid-level data engineers, providing technical guidance on best practices for Snowflake optimization, Informatica development, and secure data handling.
- Leverage cloud technologies to optimize data operations and enhance performance.
- Collaborate across business and technical teams to ensure effective communication and successful project delivery.
- Manage large-scale data projects from inception to completion, ensuring timely and successful outcomes.
Required Skills
- Bachelor’s degree and 6+ years of progressive experience in data engineering or related fields.
- 5 years of hands-on experience designing and deploying production ELT/ETL solutions using Informatica Cloud (IICS), including Mapping Designer, Data Integration, and API management.
- 5 years of experience working with Snowflake in a data engineering capacity, including advanced features like Streams, Tasks, stored procedures, UDFs, and external functions.
- Expert-level proficiency in SQL, including complex window functions, CTEs, recursive queries, and Snowflake-specific optimizations (zero-copy cloning, time travel, result caching).
- Proven experience implementing data governance policies and security compliance frameworks, using tools like Collibra, Alation, or native Snowflake features.
- Deep understanding of data security principles, including encryption standards (AES-256), key management (AWS KMS, Azure Key Vault), and secure data sharing protocols.
- Strong Python skills for data transformation, automation, and API integration.
- Proven track record of designing and implementing enterprise system integrations for seamless data interoperability.
- Proficiency in data lakehouse architecture and data product development.
- Excellent communication skills for effective collaboration across diverse teams.