{"id":1585,"date":"2023-03-14T05:17:52","date_gmt":"2023-03-14T03:17:52","guid":{"rendered":"https:\/\/www.lbscience.org\/en\/2025\/11\/20\/talking-with-a-machine\/"},"modified":"2026-03-07T05:41:15","modified_gmt":"2026-03-07T03:41:15","slug":"talking-with-a-machine","status":"publish","type":"post","link":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/","title":{"rendered":"Talking with a Machine"},"content":{"rendered":"

For many of us, the term 'artificial intelligence' (AI)\u00a0 brings up images of science fiction, where a humanoid robot displays human-level intelligence (if you were born in the 80s or 90s, imagine it with an Austrian accent amid explosions). This is an example of general<\/span><\/i> artificial intelligence, also known as \"strong\" artificial intelligence. This means a machine can do any cognitive task that a human can do (even though the question \u201cWhat is intelligence?\u201d is an open philosophical one that we will not address here). For obvious reasons, the media and other companies that work with this technology, make it seem mysterious, but experts in this field have long been saying: \u201cStop using the term artificial intelligence to describe everything. People talk as though computers can think, but they can't\u201d [1]. Today\u2019s machines are impressive and sophisticated, but they can only perform very specific tasks, and it has taken a lot of time and effort to design and train them to do these things. But how good are these machines at performing those tasks, and what are their limitations? We will talk about it in more detail in this post.<\/span><\/span><\/p>\n

In the previous chapters of \u201cArtificial Intelligence\u201d: \"Machine learning\" is a general term for algorithms and mathematical analyses that enable a computer to generalize, or<\/span> to make a decision about cases it has not previously encountered and for which it was not explicitly programmed. The process may be compared to a student learning from examples in the classroom and then using that knowledge to answer an unfamiliar exam question.\u00a0 Depending on the application, these algorithms may use mathematics from different fields like statistics and signal processing. In recent years, with the growth of data and enhanced computing power, algorithms based on artificial neural networks are becoming increasingly popular.<\/span><\/p>\n

Although the term \u201cneuron\u201d is inspired by the brain, it actually refers to a fairly simple mathematical computation and constitutes the basic building block of all the sophisticated machines that we almost believed would soon destroy humanity. The neuron receives multiple numerical attributes (called features), multiplies each by a weight (thereby prioritizing their influence), and applies a non-linear activation function to the weighted sum (read more on why this is important here [2]). A network is formed by many interconnected neurons organized in layers (see Figure 1). Increasing the \u201cdepth\u201d of the network (i.e., adding more layers) yields more complex connections, and this approach is known as deep learning [3].<\/span><\/p>\n

\"\"<\/p>\n

 <\/p>\n

Figure 1: A single neuron (left) and a neural network with several layers\u2014each column is a layer (right)<\/span><\/p>\n

During the training (or learning) phase, the network is exposed to numerous examples and adjusts the weights of each neuron to minimize the discrepancy between the network\u2019s computed output and the actual result provided by the examples (this process is explained in [3]). This process highlights a significant limitation of the algorithm: its effectiveness is dependent on the quality of the training data and the examples it has been exposed to. Let us suppose that we train the network to distinguish between images of dogs and cats. Should we now input an image of a Ninja Turtle, for example, it is likely that the output will label it as either a cat or a dog. It is important to note that the structure described so far is a fairly basic network used widely, but additional structures (called \u201carchitectures\u201d) exist for different applications.<\/span><\/p>\n

Let us now focus on a machine that has recently been receiving a great deal of attention: OpenAI\u2019s ChatGPT. It is a type of \u201cbot\u201d that allows free-text \u201cconversations\u201d and typically provides responses that are highly human-like. The structure of this machine differs considerably from the basic network described above. It is a Large Language Model, that uses a technique known as self-attention to analyze entire sentences and the relationships between words. This is achieved by encoding free text into a set of weights that represent features (for a detailed explanation, see [4]). The network was trained on vast amounts of internet text (mainly information current up to 2021) to predict the reply to the encoded text, which is then translated, using the same method, back into free text that appears human-generated. This is a critical point: ChatGPT is designed to predict the next word in a text. The system was not designed to evaluate the accuracy of its output, nor does it seek to do so. Therefore, when used to respond to general inquiries, the result is usually an impressive-sounding text, but the answers can often be uninformative or simply incorrect (a phenomenon called hallucination). For example, if the machine is tasked with providing citations in a specific field, it may present seemingly relevant titles and even familiar author names, but the papers may be non-existent. You can easily challenge it with slightly complex topics in which you have expertise and identify inaccuracies or outright nonsense.<\/span><\/p>\n

Another serious issue that has come to light is that the machines are learning from information available on the internet, meaning that they are highly susceptible to human biases. As demonstrated in a \u201cKAN\u201d news item [5] when a machine is instructed to generate an image of a doctor, it produces a male image, however, when it is asked to create an image of a housekeeper, it produces a female image.\u00a0<\/span><\/p>\n

Further refinements have set ChatGPT apart from previous versions and similar algorithms, contributing to its well-deserved reputation. It is important to note that the training on internet text is further improved by human feedback [7] (using another machine-learning approach called Reinforcement Learning, which is a topic for a separate post). At this time, it would be premature to panic and look for a new career. Intelligent use of tools such as ChatGPT can be beneficial, however, it is important to keep in mind their constraints and not to rely on them for life-changing decisions.<\/span><\/p>\n

Hebrew editing: Shir Rosenblum-Man
\n<\/span>English editing: Gloria Volohonsky<\/p>\n

\n

References:<\/strong><\/p>\n

    \n
  1. A machine-learning expert opposes the use of the term \u201cartificial intelligence\u201d<\/span><\/a>.<\/span><\/li>\n
  2. On non-linear activation functions<\/span><\/a>.<\/span><\/li>\n
  3. Post on artificial neural networks and deep learning<\/span><\/a><\/li>\n
  4. How a Large Language Model understands relationships within sentences<\/span><\/a><\/li>\n
  5. Examples of bias in image generators<\/span><\/a><\/li>\n
  6. More on what makes ChatGPT unique and learning from human feedback<\/span><\/a><\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"

    For many of us, the term 'artificial intelligence' (AI)\u00a0 brings up images of science fiction, where a humanoid robot displays human-level intelligence (if you were born in the 80s or 90s, imagine it with an Austrian accent amid explosions). This is an example of general artificial intelligence, also known as \"strong\" artificial intelligence. This means […]<\/p>\n","protected":false},"author":169,"featured_media":1817,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[20,12],"tags":[],"class_list":["post-1585","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-computer-science","category-engineering"],"acf":[],"yoast_head":"\nTalking with a Machine - Little, Big Science<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Talking with a Machine - Little, Big Science\" \/>\n<meta property=\"og:description\" content=\"For many of us, the term 'artificial intelligence' (AI)\u00a0 brings up images of science fiction, where a humanoid robot displays human-level intelligence (if you were born in the 80s or 90s, imagine it with an Austrian accent amid explosions). This is an example of general artificial intelligence, also known as "strong" artificial intelligence. This means […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/\" \/>\n<meta property=\"og:site_name\" content=\"Little, Big Science\" \/>\n<meta property=\"article:published_time\" content=\"2023-03-14T03:17:52+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-03-07T03:41:15+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"2400\" \/>\n\t<meta property=\"og:image:height\" content=\"1350\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"\u05d3"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"\u05d3"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/\",\"url\":\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/\",\"name\":\"Talking with a Machine - Little, Big Science\",\"isPartOf\":{\"@id\":\"https:\/\/www.lbscience.org\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg\",\"datePublished\":\"2023-03-14T03:17:52+00:00\",\"dateModified\":\"2026-03-07T03:41:15+00:00\",\"author\":{\"@id\":\"https:\/\/www.lbscience.org\/en\/#\/schema\/person\/c7edde6398eb7388d24a4b8fdd017279\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#primaryimage\",\"url\":\"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg\",\"contentUrl\":\"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg\",\"width\":2400,\"height\":1350},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.lbscience.org\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Talking with a Machine\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.lbscience.org\/en\/#website\",\"url\":\"https:\/\/www.lbscience.org\/en\/\",\"name\":\"Little, Big Science\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.lbscience.org\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.lbscience.org\/en\/#\/schema\/person\/c7edde6398eb7388d24a4b8fdd017279\",\"name\":\"\u05d3\\\"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.lbscience.org\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4d5c2cafe3a484ca4925b2f1601e6471?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4d5c2cafe3a484ca4925b2f1601e6471?s=96&d=mm&r=g\",\"caption\":\"\u05d3\\\"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1\"},\"description\":\"\u05d0\u05dc\u05d2\u05d5\u05e8\u05d9\u05ea\u05de\u05d0\u05d9 \u05d5\u05d7\u05d5\u05e7\u05e8 \u05d1\u05ea\u05d7\u05d5\u05dd \u05d4\u05e8\u05d5\u05d1\u05d5\u05d8\u05d9\u05e7\u05d4 \u05d4\u05d0\u05d5\u05d8\u05d5\u05e0\u05d5\u05de\u05d9\u05ea. \u05d1\u05e2\u05dc \u05d3\u05d5\u05e7\u05d8\u05d5\u05e8\u05d8 \u05d1\u05d4\u05e0\u05d3\u05e1\u05ea \u05de\u05db\u05d5\u05e0\u05d5\u05ea \u05de\u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df \u05d1\u05d3\u05d9\u05e0\u05de\u05d9\u05e7\u05d4 \u05d5\u05d1\u05e7\u05e8\u05d4 \u05e9\u05dc \u05de\u05e2\u05e8\u05db\u05d5\u05ea \u05e8\u05d5\u05d1\u05d5\u05d8\u05d9\u05d5\u05ea.\",\"url\":\"https:\/\/www.lbscience.org\/en\/author\/bennygamus\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Talking with a Machine - Little, Big Science","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/","og_locale":"en_US","og_type":"article","og_title":"Talking with a Machine - Little, Big Science","og_description":"For many of us, the term 'artificial intelligence' (AI)\u00a0 brings up images of science fiction, where a humanoid robot displays human-level intelligence (if you were born in the 80s or 90s, imagine it with an Austrian accent amid explosions). This is an example of general artificial intelligence, also known as \"strong\" artificial intelligence. This means […]","og_url":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/","og_site_name":"Little, Big Science","article_published_time":"2023-03-14T03:17:52+00:00","article_modified_time":"2026-03-07T03:41:15+00:00","og_image":[{"width":2400,"height":1350,"url":"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg","type":"image\/jpeg"}],"author":"\u05d3\"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1","twitter_card":"summary_large_image","twitter_misc":{"Written by":"\u05d3\"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/","url":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/","name":"Talking with a Machine - Little, Big Science","isPartOf":{"@id":"https:\/\/www.lbscience.org\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#primaryimage"},"image":{"@id":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#primaryimage"},"thumbnailUrl":"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg","datePublished":"2023-03-14T03:17:52+00:00","dateModified":"2026-03-07T03:41:15+00:00","author":{"@id":"https:\/\/www.lbscience.org\/en\/#\/schema\/person\/c7edde6398eb7388d24a4b8fdd017279"},"breadcrumb":{"@id":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#primaryimage","url":"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg","contentUrl":"https:\/\/www.lbscience.org\/en\/wp-content\/uploads\/sites\/3\/2023\/03\/en_meme-5.jpeg","width":2400,"height":1350},{"@type":"BreadcrumbList","@id":"https:\/\/www.lbscience.org\/en\/2023\/03\/14\/talking-with-a-machine\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.lbscience.org\/en\/"},{"@type":"ListItem","position":2,"name":"Talking with a Machine"}]},{"@type":"WebSite","@id":"https:\/\/www.lbscience.org\/en\/#website","url":"https:\/\/www.lbscience.org\/en\/","name":"Little, Big Science","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.lbscience.org\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.lbscience.org\/en\/#\/schema\/person\/c7edde6398eb7388d24a4b8fdd017279","name":"\u05d3\"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.lbscience.org\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/4d5c2cafe3a484ca4925b2f1601e6471?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4d5c2cafe3a484ca4925b2f1601e6471?s=96&d=mm&r=g","caption":"\u05d3\"\u05e8 \u05d1\u05e0\u05d9 \u05d2\u05d0\u05de\u05d5\u05e1"},"description":"\u05d0\u05dc\u05d2\u05d5\u05e8\u05d9\u05ea\u05de\u05d0\u05d9 \u05d5\u05d7\u05d5\u05e7\u05e8 \u05d1\u05ea\u05d7\u05d5\u05dd \u05d4\u05e8\u05d5\u05d1\u05d5\u05d8\u05d9\u05e7\u05d4 \u05d4\u05d0\u05d5\u05d8\u05d5\u05e0\u05d5\u05de\u05d9\u05ea. \u05d1\u05e2\u05dc \u05d3\u05d5\u05e7\u05d8\u05d5\u05e8\u05d8 \u05d1\u05d4\u05e0\u05d3\u05e1\u05ea \u05de\u05db\u05d5\u05e0\u05d5\u05ea \u05de\u05d4\u05d8\u05db\u05e0\u05d9\u05d5\u05df \u05d1\u05d3\u05d9\u05e0\u05de\u05d9\u05e7\u05d4 \u05d5\u05d1\u05e7\u05e8\u05d4 \u05e9\u05dc \u05de\u05e2\u05e8\u05db\u05d5\u05ea \u05e8\u05d5\u05d1\u05d5\u05d8\u05d9\u05d5\u05ea.","url":"https:\/\/www.lbscience.org\/en\/author\/bennygamus\/"}]}},"_links":{"self":[{"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/posts\/1585","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/users\/169"}],"replies":[{"embeddable":true,"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/comments?post=1585"}],"version-history":[{"count":22,"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/posts\/1585\/revisions"}],"predecessor-version":[{"id":2691,"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/posts\/1585\/revisions\/2691"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/media\/1817"}],"wp:attachment":[{"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/media?parent=1585"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/categories?post=1585"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.lbscience.org\/en\/wp-json\/wp\/v2\/tags?post=1585"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}