From bd228c9cdd74f7c5aaff306bb641e254f8b178a6 Mon Sep 17 00:00:00 2001 From: Babak Naderi Date: Tue, 7 Oct 2025 13:29:02 +0300 Subject: [PATCH 01/28] update P804 to runon hitapp server --- src/P808Template/P808_multi.html | 64 +++++++++++++++++++------------- 1 file changed, 38 insertions(+), 26 deletions(-) diff --git a/src/P808Template/P808_multi.html b/src/P808Template/P808_multi.html index 1660376..74b1364 100644 --- a/src/P808Template/P808_multi.html +++ b/src/P808Template/P808_multi.html @@ -7,11 +7,9 @@ --> - - - - - + + + @@ -243,7 +241,7 @@ - - - - @@ -2614,7 +2627,7 @@
Warning

- +

@@ -3002,8 +3015,7 @@

 
-
Result:  
+
Result:  
@@ -3156,7 +3168,7 @@

Please click on Allow (on some of smartphones there will be no message). We do not process or record any audio with your microphone.
- +
@@ -3330,7 +3342,7 @@

Attention:

Scores showing the best quality are: Not noisy, Optimal loudness, Continuous, Uncolored, No reverb, Not distorted, and Excellent quality.

Scores showing the worst quality are: Noisy, Sub-optimal loudness, Discontinuous, Colored, High reverb, Very distorted, and Bad quality.

- +

@@ -3391,10 +3403,10 @@

@@ -3478,7 +3490,7 @@

Ratings

Thanks for your participation. Please perform more HITs from this group when they are available for you.

Note: The submit button works only if you answer to all questions. Make sure to answer to all 7 questions in each - trial. Click here to see which + trial. Click here to see which questions in the "Rating" section are not answered?

From 9f612e41533d8e69454103eda65f46d1eca6b757 Mon Sep 17 00:00:00 2001 From: Babak Naderi Date: Tue, 7 Oct 2025 17:48:31 +0300 Subject: [PATCH 02/28] fixes on p.804, updated personalized p835 and ACR --- src/P808Template/ACR_template.html | 73 ++++--- src/P808Template/P808_multi.html | 117 ++--------- .../P835_personalized_template3.html | 197 ++++++------------ src/master_script.py | 96 ++++++++- 4 files changed, 227 insertions(+), 256 deletions(-) diff --git a/src/P808Template/ACR_template.html b/src/P808Template/ACR_template.html index c12d505..2e7a8df 100644 --- a/src/P808Template/ACR_template.html +++ b/src/P808Template/ACR_template.html @@ -7,9 +7,9 @@ --> - - - + + + @@ -49,7 +49,7 @@ fieldset { padding: 10px; background:#fbfbfb; border-radius:5px; margin-bottom:5px; } - - - @@ -1108,19 +1121,19 @@

  • You must perform the task in a quiet environment
  • Do not change the volume after modifying it in the Setup section.
    • - -

    Payment:

    -

    The result of this experiment is very important for us and other scientist working in this area. We have methods that analyse the consistency of your answers. We will use these methods to rank the submitted assignments according to quality.

    -

    For this experiment, we will pay a base reward of ${{cfg.hit_base_payment}}/HIT for every accepted HIT. We have made available a set of 0 different HITs. You will receive a bonus of:

    - -
      -
    • ${{cfg.quantity_bonus}}/HIT (for a total of ${{cfg.sum_quantity}}/HIT) if you submit more than {{cfg.quantity_hits_more_than}} HITs that got accepted or
      • -
    • ${{cfg.quality_bonus}}/HIT (for a total of ${{cfg.sum_quality }}/HIT) if you submit more than {{cfg.quantity_hits_more_than}} HITs and be in the top {{cfg.quality_top_percentage}}% quality group.
      • -
    - -

    Bonuses will be assigned with in 7 days.

    - Please perform up to 0 HITs from this group. If you do more than that, the rest will be rejected. - +
    +

    Payment:

    +

    The result of this experiment is very important for us and other scientist working in this area. We have methods that analyse the consistency of your answers. We will use these methods to rank the submitted assignments according to quality.

    +

    For this experiment, we will pay a base reward of ${{cfg.hit_base_payment}}/HIT for every accepted HIT. We have made available a set of 0 different HITs. You will receive a bonus of:

    + +
      +
    • ${{cfg.quantity_bonus}}/HIT (for a total of ${{cfg.sum_quantity}}/HIT) if you submit more than {{cfg.quantity_hits_more_than}} HITs that got accepted or
      • +
    • ${{cfg.quality_bonus}}/HIT (for a total of ${{cfg.sum_quality }}/HIT) if you submit more than {{cfg.quantity_hits_more_than}} HITs and be in the top {{cfg.quality_top_percentage}}% quality group.
      • +
    + +

    Bonuses will be assigned with in 7 days.

    + Please perform up to 0 HITs from this group. If you do more than that, the rest will be rejected. +

    Attention:

    This hit includes one or more Control clips (gold clips). Control clips are ones that we know that answer for and should be very easy to rate (they are clearly very good or very poor). They may target one or more scales. We include control clips in the HIT to ensure raters are paying attention and their environment hasn't changed. Wrong answer to control clip(s) will result in rejection of the HIT.

    @@ -1414,7 +1427,7 @@

     
    -
    Result:  
    +
    Result:  
    @@ -1539,7 +1552,7 @@

    After that, you might see a popup message from your browser asking for allowance to use your microphone. Please click on Allow (on some of smartphones there will be no message). We do not process or record any audio with your microphone.
    - +
    @@ -1572,8 +1585,8 @@

    Click next to answer all 0 questions.
    @@ -1614,8 +1627,8 @@

    Ratings

    Click next to answer all 0 questions, then submit your response.
    diff --git a/src/P808Template/P808_multi.html b/src/P808Template/P808_multi.html index 74b1364..5ab2b2b 100644 --- a/src/P808Template/P808_multi.html +++ b/src/P808Template/P808_multi.html @@ -345,85 +345,7 @@ bw_max: "FB" } - /* - var config = { - testing: "true", - cookieName: "{{cfg.cookie_name}}", - qualificationCookieName: "{{cfg.qual_cookie_name}}", - qualificationValidFor: 43200, - forceRetrainingInHours: 1.5, - showSetupEveryMinutes: 60, - debug: "true", - questionUrls: - ['https://s3-us-west-1.amazonaws.com/itutest.qu.tuberlin.de/401/D401_c01_ef02_s001.wav', - 'https://s3-us-west-1.amazonaws.com/itutest.qu.tuberlin.de/401/D401_c01_ef02_s002.wav', - - ], - trainingUrls: ['https://p835-ref-lang.s3.amazonaws.com/tps/i01_f1_1_short.wav','https://s3-us-west-1.amazonaws.com/itutest.qu.tuberlin.de/401/D401_c01_ef02_s001.wav' - ], - - - - knownQuestionInTrainingUrl: "https://p835-ref-lang.s3.amazonaws.com/tps/i01_f1_1_short0001.wav", - knownQuestionInTrainingAns: "1", - - training_gold_clips: [ - //{"url":"https://p835-ref-lang.s3.amazonaws.com/tps/i01_f1_1_short.wav", "sig":{"ans": 1, msg:"sig_is_wrong", var:1},"bak":{"ans": 1, msg:"Bak_is_wrong", var:1}, "ovrl":{"ans": 1, msg:"ovrl_is_wrong", var:1}} - {"url":"https://p835-ref-lang.s3.amazonaws.com/tps/i01_f1_1_short.wav", - //2 - "noise":{"ans": "aHR0cHM6Ly9wODM1LXJlZi1sYW5nLnMzLmFtYXpvbmF3cy5jb20vdHBzL2kwMV9mMV8xX3Nob3J0Lndhdl8x", msg:"noise 1 is correct", var:1}, - //5 - "ovrl":{"ans": "aHR0cHM6Ly9wODM1LXJlZi1sYW5nLnMzLmFtYXpvbmF3cy5jb20vdHBzL2kwMV9mMV8xX3Nob3J0Lndhdl81", msg:"ovrl 5 is correct", var:1}} - ], - - knownQuestionUrl: "https://s3-us-west-1.amazonaws.com/itutest.qu.tuberlin.de/401/D401_c01_ef02_s002.wav", - knownQuestionAns: "", - // default variance is 1 if a scale is not relevant, remove it from list - goldClip: { - "url":'https://p835-ref-lang.s3.amazonaws.com/tps/i01_f1_1_short.wav', - 'noise':'aHR0cHM6Ly9tbHZpZGVvcHJlbS5ibG9iLmNvcmUud2luZG93cy5uZXQvbWxjb2RlYy1nYW4tcHJlbS90bXAvMXNlYy53YXZfMg==', - 'ovrl': 'aHR0cHM6Ly9tbHZpZGVvcHJlbS5ibG9iLmNvcmUud2luZG93cy5uZXQvbWxjb2RlYy1nYW4tcHJlbS90bXAvMXNlYy53YXZfMg==', - 'n_fail_show_warning': 1, - 'n_fail_block': 2 - }, - goldClip2: { - url: "${gold_url_2}", - sig_ans:"${gold_sig_ans_2}", - noise_ans:"${gold_noise_ans_2}", - disc_ans:"${gold_disc_ans_2}", - col_ans:"${gold_col_ans_2}", - loud_ans:"${gold_loud_ans_2}", - reverb_ans:"${gold_reverb_ans_2}", - ovrl_ans: "${gold_ovrl_ans_2}", - dummy:"dummy" - }, - randomizeTrainingQuestions: "true", - randomizeRatingQuestions: "true", - allowedMaxHITsInProject: 10, - allowedMaxContinuesSessionDurationInMinutes: 45, - qualification: { - mother_tongue: ["english", "en"], - ld_in: ["in-ear", "over-ear"], - working_area: "N", - hearing: "normal", - num1: "Mjg5", - num2: "MTU2", - num3: "ODE1", - num4: "Njgw", - num5: "OTEz", - }, - cmp_correct_answers: ['aHR0cHM6Ly9hdWRpb3NhbXBsZXNwODA4LmJsb2IuY29yZS53aW5kb3dzLm5ldC9wODA4LWFzc2V0cy9jbGlwcy9zYW1wbGVfam5kLzUwU19mZW1hbGUxLndhdg==', - 'aHR0cHM6Ly9hdWRpb3NhbXBsZXNwODA4LmJsb2IuY29yZS53aW5kb3dzLm5ldC9wODA4LWFzc2V0cy9jbGlwcy9zYW1wbGVfam5kLzUwU19mZW1hbGUyLndhdg==', - 'aHR0cHM6Ly9hdWRpb3NhbXBsZXNwODA4LmJsb2IuY29yZS53aW5kb3dzLm5ldC9wODA4LWFzc2V0cy9jbGlwcy9zYW1wbGVfam5kLzUwU19tYWxlMS53YXY=', - 'aHR0cHM6Ly9hdWRpb3NhbXBsZXNwODA4LmJsb2IuY29yZS53aW5kb3dzLm5ldC9wODA4LWFzc2V0cy9jbGlwcy9zYW1wbGVfam5kLzUwU19tYWxlMi53YXY='], - cmp_max_n_feedback: 4, - cmp_pass_threshold: 2, - emailAddress: "test@test.de", - bw_min: "FB", - bw_max: "FB", - loop_until_next: 1 - }*/ // if performing of this assignment is already counted var hitCounterIncreased = false; @@ -2683,32 +2605,33 @@

  • You must perform the task in a quiet environment
  • Do not change the volume after modifying it in the Setup section.
    • +
    +

    Payment:

    +

    The result of this experiment is very important for us and other scientist working in this + area. We have methods that analyse the consistency of your answers. We will use these methods to + rank the submitted assignments according to quality.

    +

    For this experiment, we will pay a base reward of ${{cfg.hit_base_payment}}/HIT for every + accepted HIT. We have made available a set of 0 different HITs. You + will receive a bonus of:

    -

    Payment:

    -

    The result of this experiment is very important for us and other scientist working in this - area. We have methods that analyse the consistency of your answers. We will use these methods to - rank the submitted assignments according to quality.

    -

    For this experiment, we will pay a base reward of ${{cfg.hit_base_payment}}/HIT for every - accepted HIT. We have made available a set of 0 different HITs. You - will receive a bonus of:

    - -
      -
    • ${{cfg.quantity_bonus}}/HIT (for a total of ${{cfg.sum_quantity}}/HIT) if you submit - more than {{cfg.quantity_hits_more_than}} HITs or
      • -
    • ${{cfg.quality_bonus}}/HIT (for a total of ${{cfg.sum_quality }}/HIT) if you submit - more than {{cfg.quantity_hits_more_than}} HITs and be in the top - {{cfg.quality_top_percentage}}% quality group.
      • -
    - -

    Bonuses will be assigned with in 7 days.

    - Please perform up to 0 HITs from this group. If you do more than - that, the rest will be rejected. +
      +
    • ${{cfg.quantity_bonus}}/HIT (for a total of ${{cfg.sum_quantity}}/HIT) if you submit + more than {{cfg.quantity_hits_more_than}} HITs or
      • +
    • ${{cfg.quality_bonus}}/HIT (for a total of ${{cfg.sum_quality }}/HIT) if you submit + more than {{cfg.quantity_hits_more_than}} HITs and be in the top + {{cfg.quality_top_percentage}}% quality group.
      • +
    +

    Bonuses will be assigned with in 7 days.

    + Please perform up to 0 HITs from this group. If you do more than + that, the rest will be rejected. +

    Attention:

    This hit includes one or more Control clips (gold clips). Control clips are ones that we know that answer for and should be very easy to rate (they are clearly very good or very poor). They may target one or more scales. We include control clips in the HIT to ensure raters are paying attention and their environment hasn't changed. Wrong answer to control clip(s) will result in rejection of the HIT.

    + diff --git a/src/P808Template/P835_personalized_template3.html b/src/P808Template/P835_personalized_template3.html index 1a18006..bcbc443 100644 --- a/src/P808Template/P835_personalized_template3.html +++ b/src/P808Template/P835_personalized_template3.html @@ -7,9 +7,9 @@ --> - - - + + + @@ -108,7 +108,7 @@ } - - - - @@ -1807,31 +1748,32 @@

  • You must perform the task in a quiet environment
  • Do not change the volume after modifying it in the Setup section.
    • +
    +

    Payment:

    +

    The result of this experiment is very important for us and other scientist working in this + area. We have methods that analyse the consistency of your answers. We will use these methods to + rank the submitted assignments according to quality.

    +

    For this experiment, we will pay a base reward of ${{cfg.hit_base_payment}}/HIT for every + accepted HIT. We have made available a set of 0 different HITs. You + will receive a bonus of:

    -

    Payment:

    -

    The result of this experiment is very important for us and other scientist working in this - area. We have methods that analyse the consistency of your answers. We will use these methods to - rank the submitted assignments according to quality.

    -

    For this experiment, we will pay a base reward of ${{cfg.hit_base_payment}}/HIT for every - accepted HIT. We have made available a set of 0 different HITs. You - will receive a bonus of:

    - -
      -
    • ${{cfg.quantity_bonus}}/HIT (for a total of ${{cfg.sum_quantity}}/HIT) if you have - more than {{cfg.quantity_hits_more_than}} HITs accepted or
      • -
    • ${{cfg.quality_bonus}}/HIT (for a total of ${{cfg.sum_quality }}/HIT) if you submit - more than {{cfg.quantity_hits_more_than}} HITs and be in the top - {{cfg.quality_top_percentage}}% quality group.
      • -
    - -

    Bonuses will be assigned with in 7 days.

    - Please perform up to 0 HITs from this group. If you do more than - that, the rest will be rejected. +
      +
    • ${{cfg.quantity_bonus}}/HIT (for a total of ${{cfg.sum_quantity}}/HIT) if you have + more than {{cfg.quantity_hits_more_than}} HITs accepted or
      • +
    • ${{cfg.quality_bonus}}/HIT (for a total of ${{cfg.sum_quality }}/HIT) if you submit + more than {{cfg.quantity_hits_more_than}} HITs and be in the top + {{cfg.quality_top_percentage}}% quality group.
      • +
    +

    Bonuses will be assigned with in 7 days.

    + Please perform up to 0 HITs from this group. If you do more than + that, the rest will be rejected. +

    Attention:

    This hit includes one or more Control clips (gold clips). Control clips are ones that we know that answer for and should be very easy to rate (they are clearly very good or very poor). They may target one or more scales. We include control clips in the HIT to ensure raters are paying attention and their environment hasn't changed. Wrong answer to control clip(s) will result in rejection of the HIT.

    + @@ -2219,8 +2161,7 @@

     
    -
    Result:  
    +
    Result:  
    @@ -2373,7 +2314,7 @@

    Please click on Allow (on some of smartphones there will be no message). We do not process or record any audio with your microphone.
    - +
    @@ -2466,10 +2407,10 @@

    Important examples: