Skip to main content

The glass box design philosophy

There is an interesting paradox in context of developing data analysis software. On one side, there are clear benefits of designing tools that are easy to use, robust and require as little manual intervention or user expertise as possible. Such design philosophy allows more users to take advantage of the tools and apply them automatically to large heterogeneous datasets. On the other side, blindly applying tools that are not fully understood or do not provide useful information on whether the input data meets their assumptions can raise serious concerns. Developers take not only great pride in the quality of their software but also feel responsible for how the software is being used. Unexperienced users can misuse a “black box” tool and obtain misleading results. Whether we like it or not, such situations can lead to bad reputation misattributed to the tool itself.



Ease of use seems to be at odds with avoiding misuse. Extending your user base to less experienced users can lead to mistakes. Is there a way of designing “black box” tools that can minimize misuses? I believe there is - I call it the glass box philosophy.

The glass box principles

Write educational documentation

The documentation for a data analysis tool should aspire not only to describe how to run the tool but also to explain the theory and assumptions behind the analysis. In this, it should resemble more of an academic handbook than instruction manual.

It does not mean that developers must come up with their original content if such exists already. The purpose of educational documentation is that if the user wants to understand how a tool works they can learn about it from documentation in a programming language agnostic way.

Verify or visualize assumptions

Most data analysis tools will consist of several steps each with their distinctive assumptions. If a step fails to produce expected results (in a silent way) it could have catastrophic consequences down the road. Unfortunately, in many cases, it is very hard or even impossible to programmatically verify if the results of a particular step meet quality requirements of the subsequent step. Thus, it is important that data analysis software provides an option to verify or visualize those assumptions. Such reporting capabilities might not be necessarily taken advantage by the user directly but can provide an extra layer of transparency. For example, more experienced users or reviewers of a paper describing the results could audit the reports generated by data analysis.

Guide dissemination of the results

Obviously, the purpose of running a data analysis tool is to learn something about the data from the results. In clear majority of the cases, users will share the findings with people who were not involved in the analysis and might not know the details of the tool. Whether it is an internal report or an academic paper the user that runs the tool and obtained the result bears the responsibility of explaining to others what the analysis entailed. Here the tool developers can also help by providing boilerplate language summarizing the inner workings of the tool (referencing relevant external materials when possible). Peers of the user who performed the analysis will appreciate such feature because it allows them to understand better what exactly happened to the data. In case of robust tools that use heuristics to adapt to the input data, the boilerplate language should also automatically adapt to accurately describe the analysis path that was taken.

FMRIPREP – an example of a glass box application

To better understand how a glass box application should look like let’s have a look at an example. FMRIPREP is an MR data preprocessing tool that takes whatever comes out of a magnetic resonance scanner and prepares it for higher level analysis. It was designed to adapt to a range of different scan types and use heuristics to provide quality results on a data produces by different scanners. The robustness and ease of use make it appealing to use, but also susceptible to misuse. So how does FMRIPREP implements the glass box principles?

Educational documentation

_images/workflows-3.png
Documentation provided by the developers of FMRIPREP goes beyond the instruction how to use it. It includes a detailed explanation of the data processing workflow – together with figures and references to relevant literature. This rich documentation allows interested users to understand what happens to their data. The documentation does not rely on any knowledge of Python (which is the language FMRIPREP is written in).

Reports


Preprocessing performed by FMRIPREP consist of many interdependent steps. Some of them cannot be validated in an automatic way which leads to a need for visual reports. For every processed piece of data, FMRIPREP produces an HTML report that includes figures and animations designed to highlight different data processing steps. Those reports enable users to quickly verify the validity of individual steps without the need to write any custom code or open intermediate results using specialized software.

Citation boilerplate


FMRIPREP is targeted for research use, and thus its uses will most likely lead to scientific publications. One cannot assume that readers of those publications will be familiar with FMRIPREP, so there is a need to provide an abbreviated description of processing performed by FMRIPREP. The documentation website provides such boilerplate text ready to be reused in publications that used FMRIPREP. Because FMRIPREP runs the slightly different type of processing depending on the inputs, the boilerplate text can be easily adapted via JavaScript controls listing different input options.

Cost

I hope I made a convincing argument for building robust, easy to use software that also excels in transparency. It is worth noting that the extra steps that need to be taken to turn a black box analysis tool into a glass box analysis tool require extra effort. After all guides for interpreting results and the educational documentation will not write itself and code for reporting tools will not appear out of anywhere. Nonetheless, I do feel that the glass box philosophy is worth pursuing and may reduce the amount of user support necessary for the analysis tool. Furthermore, some of the addition necessary to turn your app into a glass box (for example documentation) could be contributed by users themselves. This is a great opportunity to grow your open source contributor network.


PS I by no means invented the term “glass box” – it has been used previously (for example in the context of software testing). However, because this term fits so well with these design principles I decided to highjack it.

Comments

  1. I wish to show thanks to you just for bailing me out of this particular trouble. As a result of checking through the net and meeting techniques that were not productive, I thought my life was done.chartered accountant firms in dubai

    ReplyDelete
  2. Thanks for sharing this, I actually appreciate you taking the time to share with everybody.
    Best Institute For Data Science In Hyderabad

    ReplyDelete
  3. It is nice thing! Looks cool. Buy facebook likes for it from this page https://soclikes.com/

    ReplyDelete
  4. As always your articles do inspire me. Every single detail you have posted was great.
    certification of data science

    ReplyDelete
  5. Hello there to everyone, here everybody is sharing such information, so it's fussy to see this webpage, and I used to visit this blog day by day
    data science course in delhi

    ReplyDelete
  6. Very awesome!!! When I searched for this I found this website at the top of all blogs in search engines.
    Data Science Training in Hyderabad

    ReplyDelete
  7. Interesting article. AMCA is a leading audit firm in Dubai, UAE. We offer a variety of auditing & accounting services in Dubai. We are FTA approved tax agency.

    ReplyDelete
  8. This article is amazing. It helped me a lot. keep up the good work. data science institute in delhi/ncr

    ReplyDelete
  9. I was basically inspecting through the web filtering for certain data and ran over your blog. I am flabbergasted by the data that you have on this blog. It shows how well you welcome this subject. Bookmarked this page, will return for extra. data science course in jaipur

    ReplyDelete
  10. Really Nice Information It's Very Helpful All courses Checkout Here.
    ai courses aurangabad

    ReplyDelete
  11. I have been searching to find a comfort or effective procedure to complete this process and I think this is the most suitable way to do it effectively.
    data scientist training in malaysia

    ReplyDelete
  12. Very interesting , good job and thanks for sharing such a good blog. we also provide glass software solutions. for more info visit our website.

    ReplyDelete
  13. Looking for all the latest styles of jackets 8 ball leather jacket and coats for men? Shop the best collection of men's jackets and coats. Free shipping available.

    ReplyDelete
  14. I want to say thanks to you. I have bookmark your site for future updates.
    data scientist course in chennai

    ReplyDelete
  15. Thanks for these blog post . It is really amazing and having good knowledge about these post. I appreciate by seeing your work. glass software solutions.

    ReplyDelete
  16. Very good points you wrote here..Great stuff...I think you've made some truly interesting points.Keep up the good work.
    data science course

    ReplyDelete
  17. It has truly been an absolute pleasure visiting your site. It is a pleasure to have you on board and thanks for sharing your blog site with us - it is greatly appreciated.
    룰렛사이트탑

    ReplyDelete
  18. I was just examining through the web looking for certain information and ran over your blog.It shows how well you understand this subject. Bookmarked this page, will return for extra.

    ReplyDelete
  19. Thanks for making the sincere attempt to explain this. I think very robust about it and want to learn more. If it’s OK, as you attain more extensive knowledge 온라인바카라

    ReplyDelete
  20. This comment has been removed by the author.

    ReplyDelete
  21. Yes, I am entirely agreed with this article, and I just want say that this article is very helpful and enlightening. I also have some precious piece of concerned info !!!!!!Thanks. bitmain antminer s19

    ReplyDelete
  22. I really impressed after read this because of some quality work and informative thoughts . I just wanna say thanks for the writer and wish you all the best for coming Courtier immobilier Hull

    ReplyDelete
  23. I am hoping the same best effort from you in the future as well. In fact your creative writing skills has inspired me
    Restaurant chair

    ReplyDelete
  24. Wow, this is really interesting reading. I am glad I found this and got to read it. Great job on this content. I like it
    used motorcycles for sale

    ReplyDelete
  25. Thank you for another great article. Where else could anyone get that kind of information in such a perfect way of writing? I have a presentation next week, and I am on the look for such information polaris dealer

    ReplyDelete
  26. I am sure this post has touched all the internet viewers, its really really good paragraph on building up new webpage
    polaris dealer

    ReplyDelete
  27. There are many dissertation internet sites on-line after you uncover unsurprisingly identified in your website page. ✅
    antique display cabinet

    ReplyDelete
  28. I read a article under the same title some time ago, but this articles quality is much, much better. How you do this..
    Skip Hire Ulverston

    ReplyDelete
  29. So lot to occur over your amazing blog. Your blog procures me a fantastic transaction of enjoyable.. Salubrious lot beside the scene
    shipping from china

    ReplyDelete
  30. So lot to occur over your amazing blog. Your blog procures me a fantastic transaction of enjoyable.. Salubrious lot beside the scene
    Shipping To FBA Warehouse From China

    ReplyDelete
  31. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here! keep up the good work. Compliance Services Malta

    ReplyDelete
  32. This is such a great resource that you are providing and you give it away for free. I love seeing blog that understand the value. Im glad to have found this post as its such an interesting one! I am always on the lookout for quality posts and articles so i suppose im lucky to have found this! I hope you will be adding more in the future... Wordpress Malta

    ReplyDelete
  33. I am jovial you take pride in what you write. It makes you stand way out from many other writers that can not push high-quality content like you 토토사이트

    ReplyDelete
  34. This is important, though it's necessary to help you head over to it weblink:
    출장홈타이

    ReplyDelete
  35. Very nice article, I enjoyed reading your post, very nice share, I want to twit this to my followers. Thanks!
    토토커뮤니티

    ReplyDelete
  36. I had been tiny bit acquainted of this your broadcast provided bright clear idea
    파워사다리

    ReplyDelete
  37. I had been tiny bit acquainted of this your broadcast provided bright clear idea 스마일도메인

    ReplyDelete
  38. I had been tiny bit acquainted of this your broadcast provided bright clear idea
    메이저사이트

    ReplyDelete
  39. "Excellent article. I’m going through many of these issues as well..

    " 토토사이트

    ReplyDelete
  40. I recently came across your blog and have been reading along. I thought I would leave my first comment. I don't know what to say except that I have enjoyed reading. Nice blog. I will keep visiting this blog very often. 토토솔루션

    ReplyDelete
  41. 360DigiTMG, the top-rated organisation among the most prestigious industries around the world, is an educational destination for those looking to pursue their dreams around the globe. The company is changing careers of many people through constant improvement, 360DigiTMG provides an outstanding learning experience and distinguishes itself from the pack. 360DigiTMG is a prominent global presence by offering world-class training. Its main office is in India and subsidiaries across Malaysia, USA, East Asia, Australia, Uk, Netherlands, and the Middle East.

    ReplyDelete
  42. Thanks for sharing this. This would be a big help but I think writing an essay for college application
    needs only determination. If you are determined enough to enter college.
    leather jacket

    ReplyDelete
  43. Wishing you the best of luck for all your blogging efforts.This is my first opportunity to chat this website
    I found some interesting things and I will apply to the development of my blog.
    wedding photography packages

    ReplyDelete
  44. Thanks you for sharing this unique useful information content with us. Really awesome work. keep on blogging

    Glass companies in Nigeria

    ReplyDelete
  45. Battisti showed Tucci how he makes risotto alla Milanese at his restaurant Ratanà, but if
    부산모텔출장

    ReplyDelete
  46. "My introduction to risotto was my mother's risotto Milanese," Tucci wrote, "but I have
    부산출장

    ReplyDelete
  47. I am happy to find your distinguished way of writing the post. Now you make it easy for me to understand and implement the concept. Thank you for the post. result totomacau

    ReplyDelete

  48. I learn from a good blog, your blog is a great inspiration, thank you. India visas for US citizens are available online. US citizens can apply for an Indian visa within 5 to 10 minutes. Firstly you can read all the document requirements for Indian visa for US citizens via our website then you can apply for your Indian visa.


    ReplyDelete
  49. This comment has been removed by the author.

    ReplyDelete
  50. https://www.igotbiz.com/directory/listingdisplay.aspx?lid=192087

    https://www.jigsawplanet.com/ConnectFreelance?viewas=0255d69d5b78

    https://bbpress.org/forums/profile/freelancevisadubai/

    https://buddypress.org/members/freelancevisadubai/profile/

    https://www.pixnet.net/pcard/91053621f564324939/article/e26ba240-e65f-11ec-a0e8-49c1d4c9968e?utm_source=PIXNET&utm_medium=pcard_article&utm_content=91053621f564324939

    https://elearning.wmich.edu/d2l/lms/blog/view_userentry.d2l?ou=6606&ownerId=86384&entryId=407&ec=0&expCmd=1&sp=&gb=usr

    https://www.blogger.com/profile/02911435215444306999

    https://ameblo.jp/eddy900/entry-12747221132.html

    https://linktr.ee/connectfreelance

    ReplyDelete
  51. Truly mind blowing blog went amazed with the subject they have developed the content. These kinds of posts are really helpful to gain the knowledge of unknown things which surely triggers to motivate and learn more. Travelers can obtain a Turkey visa from anywhere in the world. It is an electronic visa that can be obtained through the internet.

    ReplyDelete
  52. https://www.vingle.net/posts/4588482
    https://c4c.tribe.so/post/the-advantages-of-hiring-a-payroll-service-in-the-uae-62cd69388f564cbc5bc412a6
    https://roggle-delivery.tribe.so/post/the-trending-stuff-about-freelance-visa-62cd6fdd5e80e003b3242f1e
    https://business-services-dubai.mystrikingly.com/
    https://professionalservicesdubai.mystrikingly.com/

    https://proexpert2112.tribe.so/post/steps-to-do-business-setup-in-dubai---explained-by-connect-me-62d15cf2ec1678b8482fde62
    https://articlization.tribe.so/post/how-dubai-will-be-the-best-destination-for-business-setup-62d163fd799c7731564f7d15
    https://legendarymedia.tribe.so/post/how-to-start-ecommerce-business-in-uae-emirates-62d1669dcad81e582f6a58a7

    ReplyDelete
  53. I truly adored visiting your post and this content was very unique. Thanks a lot for sharing this...
    Virginia Spousal Support Calculator
    Virginia Spousal Support

    ReplyDelete
  54. Great! It is interesting to read your blog, I appreciate your efforts. Thanks! best mens loung pants

    ReplyDelete
  55. Are you looking for a Property Buyers Agent Brisbane? Asset Plus Buyers Agents are your local experts with years of experience in the Brisbane property market. We can help you find the perfect property within your budget, and with all the features you're looking for. Contact us today to get started!

    ReplyDelete
  56. Are you looking for Trumpet Lessons in sydney, Australia? Standout Music Studio offers quality trumpet lessons for all levels, from beginners to advanced. Our trumpet teachers are experienced and passionate about music and will help you reach your musical goals. Contact us today to book a trumpet lesson!

    ReplyDelete
  57. Are you looking for a Townhouse Development in Melbourne, Australia? Bullseye Home Builders are the experts in a townhouse development. With many years of experience, we can help you design and build the perfect townhouse to suit your needs.

    ReplyDelete
  58. Are you looking for a teaching job in Delhi? Check out Teach India for the latest teaching job openings in Delhi. We have a wide range of jobs available for qualified and experienced teachers. Apply now and start your teaching career in Delhi today! Teach India Jobs In Delhi NCR

    ReplyDelete
  59. Are you looking for Sheer Curtains in Melbourne, Australia? Divine Interiors has a wide range of curtains to suit any home. We also offer custom-made curtains to ensure you get the perfect fit.

    ReplyDelete
  60. Are you looking for a Hacking Course in Hindi? Cyberpratibha offers the best hacking course in Hindi with 100% practical training. Learn from the experts and get real-world experience. Enrol now and get started today.

    ReplyDelete
  61. In this article, you will get to know why the demand for data scientists has increased in the industry.
    360 DigiTMG Provides
    best data science courses in hyderabad

    ReplyDelete
  62. Develop Magic is a Social Media Marketing Agency for Small Business in USA. Boost your online presence and reach your target audience effectively.

    ReplyDelete
  63. Grant Thornton is esteemed for its focus on mid-sized businesses. The firm provides audit, tax, and advisory services, offering tailored solutions and expertise to support the unique needs of growing enterprises in Dubai. best accounting firm in dubai

    ReplyDelete
  64. Fascinating read on the Glass Box Design Philosophy! 🌐🔍 The concept of transparency, both in the literal and metaphorical sense, is truly groundbreaking. The emphasis on making the inner workings of a system visible not only promotes accountability but also fosters trust between creators and users.

    Your breakdown of how the Glass Box approach encourages collaboration and open communication is eye-opening. It's a refreshing departure from traditional closed systems, and I can see how this philosophy aligns with the current trends in user-centric design.

    I appreciate the real-world examples illustrating how companies are embracing the Glass Box approach to create more user-friendly and ethical products. The idea that informed users make better decisions is powerful and aligns perfectly with the current shift towards transparency in various industries.

    The Glass Box Design Philosophy seems like a breath of fresh air in an era where consumers crave authenticity and honesty. Thanks for shedding light on this innovative approach—it's something I'll definitely be exploring further! 🌈🔓 #DesignPhilosophy #TransparencyInTech

    please check it my website : https://getbakeroo.com/

    ReplyDelete

  65. Thank you for your feedback! I'm glad you found the breakdown of the Glass Box approach insightful. Indeed, the philosophy of transparency and open communication fosters collaboration and innovation, which are essential in today's fast-paced and user-centric design landscape. By embracing transparency and allowing stakeholders to see and understand the inner workings of a project, teams can build trust, encourage feedback, and ultimately create better products and experiences for users. If you have any more questions or need further clarification on the Glass Box approach or any other topic, feel free to ask!
    When organizing a trade show in New York, ensuring the safety and security of exhibitors, attendees, and assets is paramount. Here's how to find reliable trade show security services:https://dahlcore.com/trade-show-security

    ReplyDelete
  66. WritingTree's PhD thesis writing services in India are a game-changer! Expert assistance and a commitment to excellence make them a reliable resource for scholars aiming for academic success. research paper writing services

    ReplyDelete
  67. This comment has been removed by the author.

    ReplyDelete
  68. This comment has been removed by the author.

    ReplyDelete
  69. Tyekon Research is listed in the top 10 research paper writing services in India. We have teamed up with the top-rated research paper writers to provide India's best Research Paper Writing Services.
    https://tyekonresearch.com/research-paper-writing-service.php

    ReplyDelete
  70. This comment has been removed by the author.

    ReplyDelete

Post a Comment