About:
Professional Summary: With 9 Years of experience as a Data Engineer in service industry handling multiple clients at a time. Experience in building Cloud Datawarehouse using ETL tool on Snowflake. Worked with high-performance data integration solutions that connect multiple data sources for extracting and rapidly transforming the data for loading into the pre-designed data warehouses at the same time on large database architecture which involved partitioning, materialized views and other data warehousing processes. Experience in cloud-based solution like S3, EMR, EC2 and Athena. Involved in Developing Big data Application by using different frameworks like Hadoop, Hive, Spark, Sqoop, Oozie, MongoDB, Kafka. Knowledge on handling Hive queries using Spark SQL that integrates with Spark environment with the help of sqlContext and DataFrame. Worked on processing data in the scale of terabytes of daily data volume. Migration of application be it core or semantic from Hadoop 1.3 to Hadoop 2.2 environment, automate the metadata generation, setup and code component deployment with no or minimal downtime in existing cluster. Data migration from TERADATA, MONGO DB, MySQL to HADOOP Framework.
Reviews
: : : : :
No comments:
Post a Comment