Job Description
Validate data migration processes from on-premises systems to AWS environments (RDS, S3, Redshift) and other cloud platforms. Ensure data consistency, completeness, and accuracy through comprehensive validation and reconciliation techniques. Test, monitor, and validate data ingestion, extraction, transformation, and loading (ETL/ELT) processes. Work closely with data engineers to verify that data transformations meet business and technical requirements. Develop and implement automated test scripts and validation methods to ensure repeatable and accurate testing processes. Conduct regression testing to identify issues with data flows, transformations, and reporting. Perform regular audits on migrated data to ensure data integrity, correct schema mapping, and zero data loss. Work with relevant stakeholders to identify and correct discrepancies in the migration process. Execute performance and load testing to ensure the system can handle large volumes of data migration efficiently. Identify bottlenecks, and latency issues, and recommend optimizations for high-volume data transfers. Maintain detailed and clear documentation of QA processes, issues encountered, and their resolution. Collaborate with cross-functional teams, including data engineers, database administrators, and cloud architects, to identify risks and ensure the integrity of migrated data.Validate data migration processes from on-premises systems to AWS environments (RDS, S3, Redshift) and other cloud platforms. Ensure data consistency, completeness, and accuracy through comprehensive validation and reconciliation techniques. Test, monitor, and validate data ingestion, extraction, transformation, and loading (ETL/ELT) processes. Work closely with data engineers to verify that data transformations meet business and technical requirements. Develop and implement automated test scripts and validation methods to ensure repeatable and accurate testing processes. Conduct regression testing to identify issues with data flows, transformations, and reporting. Perform regular audits on migrated data to ensure data integrity, correct schema mapping, and zero data loss. Work with relevant stakeholders to identify and correct discrepancies in the migration process. Execute performance and load testing to ensure the system can handle large volumes of data migration efficiently. Identify bottlenecks, and latency issues, and recommend optimizations for high-volume data transfers. Maintain detailed and clear documentation of QA processes, issues encountered, and their resolution. Collaborate with cross-functional teams, including data engineers, database administrators, and cloud architects, to identify risks and ensure the integrity of migrated data.