{"id":2384,"date":"2017-06-07T09:25:26","date_gmt":"2017-06-06T23:25:26","guid":{"rendered":"http:\/\/yinghuiinternational.com\/?p=2384"},"modified":"2017-06-07T09:25:26","modified_gmt":"2017-06-06T23:25:26","slug":"visualization-program-protects-statistical-significance","status":"publish","type":"post","link":"https:\/\/yinghuiinternational.com\/index.php\/2017\/06\/07\/visualization-program-protects-statistical-significance\/","title":{"rendered":"Visualization Program Protects Statistical Significance"},"content":{"rendered":"

In the modern age when Microsoft Excel lives on nearly every computer, and programs like\u00a0Qlik\u00ae<\/sup><\/a>\u00a0use advanced analytics to draw up graphical representations of big data, it\u2019s easy for users to explore large data sets for exciting correlations and discoveries.<\/p>\n

\"VisualizationsVisualizations in green represent a statistically significant finding. Findings in red are on \u201cshaky statistical ground.\u201d (Source: Kraska Lab\/Brown University)<\/span><\/span>Unfortunately, as any statistician will tell you, the ability to ask unending questions of the same data series increases the chance for\u00a0false discoveries<\/a>. This idea is termed the \u201cmultiple hypothesis error.\u201d<\/p>\n

Luckily for those of us enamored with modern data visualization software, a team of researchers from Brown University may be on their way to resolving this error.<\/p>\n

Tim Kraska, an assistant professor of computer science at Brown and a co-author of the research, describes the error. He explains, \u201cthese tools make it so easy to query data. You can test 100 hypotheses in an hour using these visualization tools. Without correcting for multiple hypothesis error, the chances are very good that you\u2019ll come across a correlation that\u2019s completely bogus.\u201d<\/p>\n

The researchers presented a new program called QUDE at the Association for Computing Machinery\u2019s\u00a0Special Interest Group on Management of Data (SIGMOD) 2017<\/a>\u00a0conference in Chicago. QUDE adds real-time statistical safeguards to interactive data exploration systems.<\/p>\n

The program highlights figures and feedback green or red to indicate their statistical significance or potential concern regarding the correlation.<\/p>\n

Ordinarily, insignificant correlations would be caught by well-established protocols in statistics. The problem is, most of these techniques are used after-the-fact, and with visualization software, more and more users are not trained in statistics, they merely rely on the program to present them with methodologies.<\/p>\n

\u201cWe don\u2019t want to wait until the end of a session to tell people if their results are valid,\u201d says Eli Upfal, a computer science professor at Brown and research co-author. Instead, Upfal explains, \u201cyou have a budget of how much false discovery risk you can take, and we update that budget in real time as a user interacts with the data.\u201d<\/p>\n

While this program, like any program, cannot guarantee complete accuracy, it\u2019s a solid step in the direction for amateur statisticians.<\/p>\n","protected":false},"excerpt":{"rendered":"

In the modern age when Microsoft Excel lives on nearly every computer, and programs like\u00a0Qlik\u00ae\u00a0use advanced analytics to draw up graphical representations of big data, it\u2019s easy for users to explore large data sets for exciting correlations and discoveries. Visualizations in green represent a statistically significant finding. Findings in red are on \u201cshaky statistical ground.\u201d … Continue reading “Visualization Program Protects Statistical Significance”<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[3,36,34],"tags":[],"class_list":["post-2384","post","type-post","status-publish","format-standard","hentry","category-big-data","category-new-ideas","category-new-tech-new-product"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p83F9T-Cs","jetpack-related-posts":[{"id":1777,"url":"https:\/\/yinghuiinternational.com\/index.php\/2016\/09\/15\/online-cloud-platform-for-operational-management\/","url_meta":{"origin":2384,"position":0},"title":"Online cloud platform for operational management","author":"yinghui","date":"September 15, 2016","format":false,"excerpt":"Schneider Electric Australia has announced updates to its Wonderware Online cloud platform for operational data management. Wonderware Online, built on the Microsoft Azure cloud platform, provides users with a solution that combines operational and information technology with security. The platform is used to consolidate distributed data sources, contextualise that data\u2026","rel":"","context":"In "New Ideas"","block_context":{"text":"New Ideas","link":"https:\/\/yinghuiinternational.com\/index.php\/category\/new-ideas\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2135,"url":"https:\/\/yinghuiinternational.com\/index.php\/2017\/01\/27\/roy-hill-partners-with-it-provider-ajilon\/","url_meta":{"origin":2384,"position":1},"title":"Roy Hill partners with IT provider Ajilon","author":"yinghui","date":"January 27, 2017","format":false,"excerpt":"Roy Hill has partnered with IT consulting and services provider Ajilon to boost its business analytics processes. Built on Microsoft Azure, Ajilon\u2019s Business Analytics platform will allow Roy Hill to gain key insights across its operations by rapidly processing, amplifying and visualising information. It will further enhance Roy Hill\u2019s operational\u2026","rel":"","context":"In "Mines and Quarry"","block_context":{"text":"Mines and Quarry","link":"https:\/\/yinghuiinternational.com\/index.php\/category\/mines-and-quarry\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":3081,"url":"https:\/\/yinghuiinternational.com\/index.php\/2018\/07\/05\/drones-on-demand-should-you-outsource\/","url_meta":{"origin":2384,"position":2},"title":"Drones on Demand: Should You Outsource?","author":"yinghui","date":"July 5, 2018","format":false,"excerpt":"Drone usage on construction jobsites is growing\u2014as is another trend related to drones. Many construction companies are foregoing training their workers on how to operate drones, and as a result, they are outsourcing the task. DRONE OUTSOURCING OPTIONS One new example of this comes from\u00a0DroneDeploy, which recently announced its Drone\u2026","rel":"","context":"In "Big Data"","block_context":{"text":"Big Data","link":"https:\/\/yinghuiinternational.com\/index.php\/category\/big-data\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":2129,"url":"https:\/\/yinghuiinternational.com\/index.php\/2017\/01\/19\/hexagon-mining-snaps-up-perth-based-tech-company-miplan\/","url_meta":{"origin":2384,"position":3},"title":"Hexagon Mining snaps up Perth-based tech company MiPlan","author":"yinghui","date":"January 19, 2017","format":false,"excerpt":"Hexagon Mining has acquired Perth-based technology company MiPlan, a developer of mobile mine software applications for field data collection, fleet management, production management and reporting. H\u00e9lio Samora, president of Arizona-based Hexagon, believes MiPlan\u2019s solutions suite will be a formidable addition to the company\u2019s technology portfolio. \u201cSafer, more productive mines depend\u2026","rel":"","context":"In "Mines and Quarry"","block_context":{"text":"Mines and Quarry","link":"https:\/\/yinghuiinternational.com\/index.php\/category\/mines-and-quarry\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/yinghuiinternational.com\/wp-content\/uploads\/2017\/01\/hexagon.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":2288,"url":"https:\/\/yinghuiinternational.com\/index.php\/2017\/03\/24\/making-condition-based-monitoring-a-reality-with-the-iot\/","url_meta":{"origin":2384,"position":4},"title":"Making condition-based monitoring a reality with the IoT","author":"yinghui","date":"March 24, 2017","format":false,"excerpt":"Condition-based monitoring is an essential component of predictive maintenance, recording changes in equipment that could lead to a fault. This is necessary across a wide range of industries, including manufacturing, mining, infrastructure, utilities and water. With the advent of the Internet of Things (IoT), the measurable condition(s) of a machine\u2026","rel":"","context":"In "\u65b0\u6280\u672f\u65b0\u4ea7\u54c1"","block_context":{"text":"\u65b0\u6280\u672f\u65b0\u4ea7\u54c1","link":"https:\/\/yinghuiinternational.com\/index.php\/category\/new-tech-new-product\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":8852,"url":"https:\/\/yinghuiinternational.com\/index.php\/2024\/10\/02\/revolutionising-screen-deck-maintenance\/","url_meta":{"origin":2384,"position":5},"title":"Revolutionising screen deck maintenance","author":"yinghui","date":"October 2, 2024","format":false,"excerpt":"Alexandra Eastwood Image: Sandvik Sandvik Rock Processing Solutions launched DeckMapp, a groundbreaking new digital platform for screen deck maintenance, at MINExpo 2024. This highly innovative, cloud-based software solution is set to transform screen deck maintenance and drive substantial improvements in the efficiency and operational performance of mineral processing plants. Accessible\u2026","rel":"","context":"In "New Ideas"","block_context":{"text":"New Ideas","link":"https:\/\/yinghuiinternational.com\/index.php\/category\/new-ideas\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/www.australianmining.com.au\/wp-content\/uploads\/2024\/10\/Sandvik-1024x681.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/www.australianmining.com.au\/wp-content\/uploads\/2024\/10\/Sandvik-1024x681.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/www.australianmining.com.au\/wp-content\/uploads\/2024\/10\/Sandvik-1024x681.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/www.australianmining.com.au\/wp-content\/uploads\/2024\/10\/Sandvik-1024x681.png?resize=700%2C400&ssl=1 2x"},"classes":[]}],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/posts\/2384","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/comments?post=2384"}],"version-history":[{"count":1,"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/posts\/2384\/revisions"}],"predecessor-version":[{"id":2385,"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/posts\/2384\/revisions\/2385"}],"wp:attachment":[{"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/media?parent=2384"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/categories?post=2384"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/yinghuiinternational.com\/index.php\/wp-json\/wp\/v2\/tags?post=2384"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}