Sr. Big Data Analyst / Developer

Posted 7 years agoSr. Big Data Analyst / DeveloperFull TimeUSAJob Posted Date: September 16, 2019The scope of the project is to build an enterprise data warehouse to integrate property, lease, unit and other important data related to prologis globally and analyze it to understand the overall performance of the organization and to improve the same. It involves extracting data from various source systems and store it in a single data store after applying required business transformations. Develop batch and streaming analytics pipelines using Apache Spark and Scala programming to materialize and refine the event results and improve its processing time Write advanced Hive, Spark SQL queries against data warehouses utilizing large datasets Built object-oriented and functional Scala programs with Apache Spark clean and transform features that performs aggregations to integrate to machine learning models Ensure that all feature deliverable’s meet quality objectives in functionality, methodologies, performance, stability, security, accessibility and data quality Design and develop advanced analytics software components using Apache Spark, Scala, AWS and Hadoop Ecosystem and integrate it with various machine learning models that are architected for re-use Design, document, and develop complex data extracts, applications and ad-hoc queries as requested by internal and external customers using Hive and Scala transformations Develop Hive scripts and EMR (Elastic Map Reduce) mappings using Amazon Web Services EMR to integrate data from different sources and apply required transformations before loading to target databases Manage the implementation of statistical data quality procedures on new data sources by applying rigorous iterative data analytics to improve scaling and system performance Develop ETL code in various databases like snowflake computing and Denoda Work on performance tuning and resource optimization of databases like SQL Server to improve the overall performance of the system Develop and maintain data engineering best practices and contribute to Insights on data analytics and visualization concepts, methods and techniques to make the system robust and compatible to adhere the changes in data requirements in future Work closely with other Data Scientists, analysts, designers and project teams to identify new areas of research Analyze the production data issues to find the root cause and provide permanent fix to avoid similar issues in future Creates and maintains Big Data Analytic pipeline engine specifications and process documentation to produce the required data deliverables (data transformation/actions, data profiling, source to target maps, ETL flows) Collaborate with business analysts and stake holders to understand the business requirements and ensure the quality of data Create solutions to real world problems and verify the results of the work deployed Prepare project and system related documentation consistent with standards and procedures outlined in the data architecture approach including data quality, security and availability requirements Work with DBA’s and QA team to move the code developed to production environment using GIT version control and BitBucket Work with cross-functional teams, such as Product management, Platform, Operations and Mobile device engineering to elaborate on functional requirements/designs of the mobile wireless analytics modules, based on the product level requirements and designs Use Jira or confluence for defect tracking and documentation Implement unit test cases for various modules and coordinated with QA team for production deployments/releases Participate in Daily Sprint Meetings; Coordinate with other team members in understanding the requirements and provide best analysis for continuing with the developmentQualification: Master ’s degree in Computer Science Engineering, Information Technology, Computer Applications, any other related field.Location: Doral, Florida.Send Resume to: HR Dept., Iblesoft Inc.,7801 NW 37TH Street, Suite LP-104, Doral, FL 33195.All employees of Iblesoft, Inc. are automatically enrolled in the employee referral program of the company. Referral fee of $1,000 will be paid if referred candidate is hired by the company.Job FeaturesJob Category ITExperience 3-9 yearsNo. of position MultipleJob Role Big Data Analyst / DeveloperApply OnlineName*Email*A valid email address is required.Phone*United States+1United Kingdom+44Afghanistan (‫افغانستان‬‎)+93Albania (Shqipëri)+355Algeria (‫الجزائر‬‎)+213American Samoa+1684Andorra+376Angola+244Anguilla+1264Antigua and Barbuda+1268Argentina+54Armenia (Հայաստան)+374Aruba+297Australia+61Austria (Österreich)+43Azerbaijan (Azərbaycan)+994Bahamas+1242Bahrain (‫البحرين‬‎)+973Bangladesh (বাংলাদেশ)+880Barbados+1246Belarus (Беларусь)+375Belgium (België)+32Belize+501Benin (Bénin)+229Bermuda+1441Bhutan (འབྲུག)+975Bolivia+591Bosnia and Herzegovina (Босна и Херцеговина)+387Botswana+267Brazil (Brasil)+55British Indian Ocean Territory+246British Virgin Islands+1284Brunei+673Bulgaria (България)+359Burkina Faso+226Burundi (Uburundi)+257Cambodia (កម្ពុជា)+855Cameroon (Cameroun)+237Canada+1Cape Verde (Kabu Verdi)+238Caribbean Netherlands+599Cayman Islands+1345Central African Republic (République centrafricaine)+236Chad (Tchad)+235Chile+56China (中国)+86Christmas Island+61Cocos (Keeling) Islands+61Colombia+57Comoros (‫جزر القمر‬‎)+269Congo (DRC) (Jamhuri ya Kidemokrasia ya Kongo)+243Congo (Republic) (Congo-Brazzaville)+242Cook Islands+682Costa Rica+506Côte d’Ivoire+225Croatia (Hrvatska)+385Cuba+53Curaçao+599Cyprus (Κύπρος)+357Czech Republic (Česká republika)+420Denmark (Danmark)+45Djibouti+253Dominica+1767Dominican Republic (República Dominicana)+1Ecuador+593Egypt (‫مصر‬‎)+20El Salvador+503Equatorial Guinea (Guinea Ecuatorial)+240Eritrea+291Estonia (Eesti)+372Ethiopia+251Falkland Islands (Islas Malvinas)+500Faroe Islands (Føroyar)+298Fiji+679Finland (Suomi)+358France+33French Guiana (Guyane française)+594French Polynesia (Polynésie française)+689Gabon+241Gambia+220Georgia (საქართველო)+995Germany (Deutschland)+49Ghana (Gaana)+233Gibraltar+350Greece (Ελλάδα)+30Greenland (Kalaallit Nunaat)+299Grenada+1473Guadeloupe+590Guam+1671Guatemala+502Guernsey+44Guinea (Guinée)+224Guinea-Bissau (Guiné Bissau)+245Guyana+592Haiti+509Honduras+504Hong Kong (香港)+852Hungary (Magyarország)+36Iceland (Ísland)+354India (भारत)+91Indonesia+62Iran (‫ایران‬‎)+98Iraq (‫العراق‬‎)+964Ireland+353Isle of Man+44Israel (‫ישראל‬‎)+972Italy (Italia)+39Jamaica+1876Japan (日本)+81Jersey+44Jordan (‫الأردن‬‎)+962Kazakhstan (Казахстан)+7Kenya+254Kiribati+686Kosovo+383Kuwait (‫الكويت‬‎)+965Kyrgyzstan (Кыргызстан)+996Laos (ລາວ)+856Latvia (Latvija)+371Lebanon (‫لبنان‬‎)+961Lesotho+266Liberia+231Libya (‫ليبيا‬‎)+218Liechtenstein+423Lithuania (Lietuva)+370Luxembourg+352Macau (澳門)+853Macedonia (FYROM) (Македонија)+389Madagascar (Madagasikara)+261Malawi+265Malaysia+60Maldives+960Mali+223Malta+356Marshall Islands+692Martinique+596Mauritania (‫موريتانيا‬‎)+222Mauritius (Moris)+230Mayotte+262Mexico (México)+52Micronesia+691Moldova (Republica Moldova)+373Monaco+377Mongolia (Монгол)+976Montenegro (Crna Gora)+382Montserrat+1664Morocco (‫المغرب‬‎)+212Mozambique (Moçambique)+258Myanmar (Burma) (မြန်မာ)+95Namibia (Namibië)+264Nauru+674Nepal (नेपाल)+977Netherlands (Nederland)+31New Caledonia (Nouvelle-Calédonie)+687New Zealand+64Nicaragua+505Niger (Nijar)+227Nigeria+234Niue+683Norfolk Island+672North Korea (조선 민주주의 인민 공화국)+850Northern Mariana Islands+1670Norway (Norge)+47Oman (‫عُمان‬‎)+968Pakistan (‫پاکستان‬‎)+92Palau+680Palestine (‫فلسطين‬‎)+970Panama (Panamá)+507Papua New Guinea+675Paraguay+595Peru (Perú)+51Philippines+63Poland (Polska)+48Portugal+351Puerto Rico+1Qatar (‫قطر‬‎)+974Réunion (La Réunion)+262Romania (România)+40Russia (Россия)+7Rwanda+250Saint Barthélemy (Saint-Barthélemy)+590Saint Helena+290Saint Kitts and Nevis+1869Saint Lucia+1758Saint Martin (Saint-Martin (partie française))+590Saint Pierre and Miquelon (Saint-Pierre-et-Miquelon)+508Saint Vincent and the Grenadines+1784Samoa+685San Marino+378São Tomé and Príncipe (São Tomé e Príncipe)+239Saudi Arabia (‫المملكة العربية السعودية‬‎)+966Senegal (Sénégal)+221Serbia (Србија)+381Seychelles+248Sierra Leone+232Singapore+65Sint Maarten+1721Slovakia (Slovensko)+421Slovenia (Slovenija)+386Solomon Islands+677Somalia (Soomaaliya)+252South Africa+27South Korea (대한민국)+82South Sudan (‫جنوب السودان‬‎)+211Spain (España)+34Sri Lanka (ශ්‍රී ලංකාව)+94Sudan (‫السودان‬‎)+249Suriname+597Svalbard and Jan Mayen+47Swaziland+268Sweden (Sverige)+46Switzerland (Schweiz)+41Syria (‫سوريا‬‎)+963Taiwan (台灣)+886Tajikistan+992Tanzania+255Thailand (ไทย)+66Timor-Leste+670Togo+228Tokelau+690Tonga+676Trinidad and Tobago+1868Tunisia (‫تونس‬‎)+216Turkey (Türkiye)+90Turkmenistan+993Turks and Caicos Islands+1649Tuvalu+688U.S. Virgin Islands+1340Uganda+256Ukraine (Україна)+380United Arab Emirates (‫الإمارات العربية المتحدة‬‎)+971United Kingdom+44United States+1Uruguay+598Uzbekistan (Oʻzbekiston)+998Vanuatu+678Vatican City (Città del Vaticano)+39Venezuela+58Vietnam (Việt Nam)+84Wallis and Futuna+681Western Sahara (‫الصحراء الغربية‬‎)+212Yemen (‫اليمن‬‎)+967Zambia+260Zimbabwe+263Åland Islands+358A valid phone number is required.Address*How do you know about this job?*Social Media Company Website Friend OthersAttach Resume*No file chosenBrowse