Win10PE SE - Contributions to Package Release

Hi HeyJoe,

slowly coming after you now 

+
The first part of your Reply 76 http://theoven.org/index.php?topic=3351.msg40212#msg40212

Utils\"Extract Wim Folders" Plugin v59 on servers now.

It will now work on your case without giving message since fallback work with 7z the way your personal cmd file.
 But if 7z fail, there will be message, and build will continue with mount. 

As We know there are many approaches for advanced folks and others to improve somthing, which mainly depending on opinion of how to make it.
My motto is: as small effort as possible but as much as needed.

Yes we all have their own priority order. 

Update on "Extract Wim Folders" Plugin
v57 -> v58 was easy, I only run plugin again with failure, v58 -> v59 I missed final check when there is failure (thanks for reporting)

I believe there are some others out there that have the same failure as yours but did not report, and probably will not report with BuildClass3.
 Well with people who use Win7PESE Win8PESE Win8.1SE for now still with only with BuildClass2 It is better Extract Wim get more automatic and run stable out of box. 

*
About The second part of your Reply 76 http://theoven.org/index.php?topic=3351.msg40212#msg40212
I feel we do not need a message with BuildClass_ScrollBox 

I already put a info button ( BuildClass_Info_Button ) which gives message reading [BuildClass_Info_Txt] section,
Put your ideas with "increased pulse rate and blood pressure" to this section in a way you think will look better, and share around. 

About your Reply 77 http://TheOven.org/index.php?topic=3351.msg40213#msg40213

Yes, communication problem ... also with selecting words. 
 As long as replies continue, in the end, people understand each other and the solution comes. 

I am patient enough to continue communicating and solve problems as long as communication continues with good intentions.   
 My English writing is still not perfect but I now understand native English and none-Native English posts a lot better, still, I miss things. 

+
btw, one may also prefer extracting all indexes to test & check different indexes easier
 (which is equal to the name I gave at history notes: HeyJoe special case      It will be a fun history for you too.  )

I'm happy to see: If one selects BuildClass=2 then simply unticking checkbox "CheckBox_Wof" in plugin Extracted_Wim_Folders.script v.057 is enough.

Only writing again :
no need to untick anymore, now all automatic. 
 as explained previously, with CheckBox_Wof enabled, when failure, plugin tries with CheckBox_Wof disabled automatically,
  first trial (on your pc with failure) only takes ~3 minutes, 2nd trial with 7z success but as you know takes more time ...

I feel in future or on another pc, you will have success with first trial, in all cases in the end it will always work fine out of the box.

Shortly:
Only select BuildClass2 is enough to auto-extract wim with the correct index.

*
Yes, there are BuildClass2 and BuildClass3 differences, more on later posts, with your help it will get better. 

Hi HeyJoe,

About your reply 79 and 80 : http://TheOven.org/index.php?topic=3351.msg40215#msg40215

now tested, Extracting .wim with 7z or wimlib, result is a bit different, in both cases you will have symbolic links extracted :
eg.
%SourceFolder%\sources\install_wim\5\Users\All Users
%SourceFolder%\sources\install_wim\5\Users\Default User

"Default User" is "Junction"
"All Users" is "Directory symbolic link" :

(
on your pc, use this:
Test.cmd

Code: [Select]

dir %SystemDrive%\Users /AH
cmd

)

wimlib extract -> "All Users" point to C:\ProgramData
7z extract -> "All Users" point to relative folder ..\sources\install_wim\ProgramData (maybe 7z bug, it should be ..\sources\install_wim\5\ProgramData)
(
also better you check results with your personal cmd file
)

+++
When I use
%SourceFolder%\sources\install_wim\Remove_Directory_5.cmd
or
%SourceFolder%\sources\install_wim\Remove_Directory_install_wim.cmd

Symbolic links deleted, not my local files. (so far for years I did my tests and later delete that way)

---->
But I guess, you delete with another method, which again I guess cause your local files deleted ?

Anyway,
I feel better extract "symbolic link folders" (both junction and "symbolic link directory") as real folders or relative folder to be on safe side with both 7z and wimlib extract,
 7z failure seems to be make it safe today (safe: I mean anyone delete with another way is on safe side)
  but who knows, maybe an update with 7z will make the result different !
   for now let me know switches for 7z and wimlib to extract "symbolic link folders" real or relative,
     I will continue with your next replies,
        let me know switches or please remind me this case later 

Hi HeyJoe,

About your reply 81  http://TheOven.org/index.php?topic=3351.msg40218#msg40218

My mistake 
Thanks, new \Components\WordPad Plugin on servers now. 

Hi HeyJoe,

about 3 missing mui files on your reply 82 http://TheOven.org/index.php?topic=3351.msg40219#msg40219 (+reply #93)

Components\"PowerShell" Plugin
Components\"MS Windows Media Player" Plugin
Apps\Network\"Mozilla Firefox ESR (P)" Plugin

updated

+
\Build\"1 - Copy Files" Plugin and \Finals\"Logon as Admin"  Plugin already have lines with mui
("1 - Copy Files" Plugin --> NewTaskMgr_CheckBox default false so line not used as default)


******


I will continue in my next free time.   

 

Hi HeyJoe,

About your comments with reply 93 94 101 http://TheOven.org/index.php?topic=3351.msg40228#msg40228

I understand your idea but
It is better to fix the real problem -> the relevant plugin which missed adding missing .mui file instead of using Require_FileQ as a fallback mechanism which will make Require_FileQ and project build significantly slower.
I had this request a lot of years (>8) before for Requıire_FileQ and change ML the way you wrote (I made a design mistake at my early times),
 but In the future, I will make Require_FileQ the same way with BuildClass3 to get build faster also with BuildClass2.

+
Additional Info:
After 1809, such a fallback mechanism exists to add missing .mui and also .mun files, when you test with sources after 1809 you will see all .mui and .mun files not missed.
 Projects designed with optimized .mui (.mui files not always required) since first days.
  I do not want to lose optimization up to 1809 (starting with Win7) which already available, but I also do not have time to continue optimization so after 1809 I made the required adjustments.
--> pros: no need to use Require_FileQ as a fallback or any other similar solution with a fallback
--> cons: not required .mui files also copied
--> pros: easier to write plugin by only writing xxx.dll (with Require,FileList or Require_FileQ or....)

As you know, you need to enable \Build\"0 - PreConfig" Plugin --> "BETA TEST - Test NOT SUPPORTED SOURCE" checkbox to test with sources after 1809

Hi HeyJoe,

About your reply 91 92 http://TheOven.org/index.php?topic=3351.msg40239#msg40239

Thanks for the heads up,
Drivers\"Audio" Plugin v34 on servers now with default "At Startup" 

Hi HeyJoe,

About Reply 94 95 96 97 98 99 http://TheOven.org/index.php?topic=3351.msg40246#msg40246

*
Components\"Network" Plugin updated
my mistake  , thanks for the fix.
I also check other Plugins for a similar mistake, only with the Network plugin.

*
Apps\System Tools\Explorer Addons\"HashTab v5 v6 (olegpov)" Plugin updated
I guess only you prefer that way, fine to me, updated the way you like.

*
Components\"Tweak Visual Effects" Plugin updated
Thanks   

*
Drivers\"Driver Integration" Plugin updated
Thanks   

*
Finals\"Logon as Admin" Plugin updated
Lines comment out now   

*
About Removed topic Data hygiene :
All forum-related things wait for Galapo (new forum engine, Data hygiene with some topics, a trial to be public open with disabled Guest login, etc.)


***
Let me know if I miss something.

 

Hi HeyJoe,

about your Reply 79 and 80 and my reply 104 :
First:

Forgot to mention/share that too:

...
    btw. pay attention: in this two scenarios wimlib-imagex.exe took all files it could find under C:\Users\All Users + C:\Users\Default User (not quite sure -further test maybe needed - only info to share)
...

I noticed later: Not only did it "... took all the files it could find under ...", it also removed them from My user profile at the same time.
Very annoying

+
Just remembered.
I had similar trouble ~ 4 years ago.
 --> Chosed the way I descriped above.

As I tried to explain in my Reply 104,
wimlib-imagex.exe does not take anything, it only extracts "Symbolic Folder Links"
About the removal of your user profile, wimlib or project never do such a thing, still I have a theory, and I take some precautions now.

First Summary:
1) wimlib-imagex.exe extracts "..\Users\All Users"  "..\Users\Default User" which points to (linked to) your local folder, wimlib-imagex.exe do things correct, nothing wrong with that.
2) 7zip extracts relatively, sounds better, but because of a failure relative links do not work.

with both wimlib-imagex.exe OR 7zip, If you create a MyExtract.cmd file to extract source
A) If you run MyExtract.cmd with "Run as Administrator" --> both wimlib-imagex and 7z will do 1) and 2)
B) If you run MyExtract.cmd without "Run as Administrator" --> windows prevent symbolic link creation if the user is not Admin.

I believe you were doing B) with 7zip, which I guess creates only empty "..\Users\All Users"  "..\Users\Default User" folders.
I guess If you do B) with wimlib, wimlib will also create only  empty "..\Users\All Users"  "..\Users\Default User" folders.

Even If you do A) with 7zip, since 7zip does a relative extraction,
 both folders probably not working,
   and even if they work it is relative folder not pointing to your local file.

Reminding, builder Run as Administrator so "Extract Wim Folders" does A)


***
I could not find a switch for 7zip and wimlib
not to extract "Symbolic Folder Links"
 or
extract "Symbolic Folder Links" as folders
 or
extract "Symbolic Folder Links"  with relative folders. (also to fix 7zip extraction to correct relative path)

Edit: wimlib using --norpfix or --rpfix do not change the result, both "Symbolic Folder Links" always point to local folders.

===>
So I made adjustments to remove these 2 "Symbolic Folder Links" ("..\Users\All Users"  "..\Users\Default User") after extract.

Utils\"Extract Wim Folders" Plugin v60 is on servers now.

This will prevent anyone from accidentally delete linked personal files under user profile etc. 

***
If you are not familiar with Symbolic Links :
I create the name "Symbolic Folder Links" to ease explain which means "Symbolic Directory" AND "Junction"
 Search "Symbolic Directory" AND "Junction" on the internet for more info,
  There is no technical term "Symbolic Folder Links" 

Reminding, I had previously provide Junction_RamDrive.cmd which you can play with to make Junction tests :

Junction_RamDrive.cmd

Code: [Select]

cd /d "%~dp0"
Set BaseFolderDrive=D:
Set BaseFolderName=1Oven_TEST_TEST_TEST_TEST_TEST_TEST_TEST_TEST
Set TargetFolderName=Win10PESE
Set RamDrive=R:

md "%RamDrive%\%BaseFolderName%\Target\%TargetFolderName%"
md "%BaseFolderDrive%\%BaseFolderName%\Target\"
rd /s /q %BaseFolderDrive%\%BaseFolderName%\Target\%TargetFolderName%"
mklink /J "%BaseFolderDrive%\%BaseFolderName%\Target\%TargetFolderName%" "%RamDrive%\%BaseFolderName%\Target\%TargetFolderName%"
pause
exit
cmd

If you have not used junction before, have fun with above cmd

******
I hope I catch you again up to this line now.



Keep them coming. 

See You

Hi HeyJoe,

I ask for a favor if you have time :

You probably notice because of ms changes GetWaikTools failed to download Win8 and Win8.1 files some weeks ago and last week.
 I am afraid there is a high possibility this will continue ...

Can you write a simple instruction for the files required for Win10PESE ? (and if you are interested in other SE, they are all similar)
 so end-user can manually provide files.

ps: Old instructions probably will fail, I have not tested and update for a long while now.

We can put your instructions to a sticky topic and/or add to Release topic http://TheOven.org/index.php?topic=2594.msg40341#msg40341

(
ps1:
I do not even have time to update Azin without the requirements to oscdimg.exe and bcdedit.exe which is easier ...
 I already drop bcdedit.exe requirement but did not update the relevant download plugin also replacing oscdimg.exe with mkisof.exe should be easier
   but I do not have time anymore even for these simple tasks ....
)

(
ps2:
It is also possible to build Win10PESE - BuildClass3 (and Win10PESE BuildClass2 with Extracted folders) without file requirements,
 but requires a work to update some plugins .... ,
  If I had time I would first update Azin since a lot easier,
   for today simple instruction to provide files manually to Win10PESE would be enough.
)

Time is the limit, and now I need full time with other life things, I should have gone last week 

See you

Hi Lancelot,

Just a quick reply so as not to leave you out in the rain.

To Your reply #111
Can't grant your kind request now. I'm away from my equipment last week and the next two or three.

I'm so sorry.

See You soon.

Edit: This was written on someone else's phone far from home just to inform You.
       I check the forum every now and then just to be up to date.

Hi HeyJoe,

Thanks for the update,
 I can only be a bit free next week or other week for Win10PESE.

A quick summary:  (In last few days I check and update Azin very very slowly since easier, with same Plugins used, experience with Azin helps to give a shoulder to Win10PESE  )
1) Win10PESE do not need oscdimg.exe 
2) Win10PESE should not need wim... files for BuildClass3 and "BuildClass2 with Extracted Wim Folders"
--> Build\"Retrieve Tools" Plugin should be updated to avoid halt if one of these cases

3) Only trouble is "Driver Integration" Plugin requires extra dism.exe and etc. , which I guess valid for all projects.
"Driver Integration" Plugin already have fallback with "Exit" if file not found and can not be downloaded,
 But it needs some improvements :
   eg. "Provide File" button to provide files manually.
      ps: Currently only Adk6 dism.exe can be downloaded, which I guess only works on Win10 Host. Better provide an option to put other dism.exe files via Plugin ui ...
   eg. Improvments on code part to "Search & Find" proper files (for also Win7PESE Win8PESE Win8.1SE) which may exists with "source" or "hostos" or "hostos with adk" .....


Only a little summary and notes for the future. 

hello
can you create a script to include

recovery system like for livesystem pro from kare.net.de
thanks
take care of yourself

Hi vigipirate,

I am still not sure what you mean
 I currently do not know the difference between "LiveSystemPro  Recovery-System" and "Win10PESE Recovery-System"
  There are special things with LiveSystemPro which I am not sure what you ask is related or not ...

But there is an easy and ready solution without conversion :

1) Download and extract Azin to the same folder with Win10PESE
--> This will also make your personal Plugins available and working with Azin + You can switch easily between Azin and Win10PESE
----> See Picture -> http://TheOven.org/index.php?topic=2594.msg40317#msg40317
(I just update zip distro to 2021.04.29..zip to make you have latest Azin Plugins)
2) Azin\"Azin Configure" Plugin -> Select LiveSystemPro
3) Azin\"Azin Configure" Plugin -> Click "Configure LiveSystemPro" button near LiveSystemPro
--> This will open LSP
4) --> Enable LSP-Script about "Recovery System" or whatever you want ...
5) Close LiveSystemPro
6) Click BluePlay button to build ---> if asked for source folder select source folder for your Win10


==> You will get all features available with LSP and Plugins without any requirement to trouble and time consuming conversions.

ok Sir

verry thank you sorry google translate

Hi HeyJoe,

Some Good News:
I just updated
Build\"Retrieve Tools" Plugin
Build\"0 - PreConfig" Plugin
--->
This makes all SE having the ability to build offline with "BuildClass2 with Extracted Wim Folders" and "BuildClass3"
I only test with HostOS-Win10x64 using all SE projects with x64-Source and offline (simply by unplug ethernet cable  ). All went fine here.

Still there maybe things missed from eyes. 
+
on \Build\"Retrieve Tools" Plugin I add "Tools Gathered" Info Button which hopefully better summarize file list for all projects.
(list created with some tests, let me know if something to fix)

*
I am not sure about current "Driver Integration" Plugin for pre Win10PESE .... but again requires time to learn and test .....

*
There are too many things to check, test and learn, with limited time these are all I can do slowly for now.
 I need virtual-Win7-Win8-Win8.1 test environments with having a big time to test mount/unmount conditions and related additions .... + other things to clearly understand all files.
  I had planed to learn all related things during Azin development so to me it can wait some more ...
    Probably I will check "Driver Integration" Plugin first .....
      Rest is up to feedback ....


****
Shortly: Good news is, we can build SE offline now. 

Slowly slowly ....

Hi HeyJoe,

Just updated "Driver Integration" Plugin v36, check History notes.
Summary:
For now "Driver Integration" Plugin requires internet
 probably only Win7PESE do not require internet (not tested)
+
Since "Driver Integration" Plugin Default False since v35, Default Projects works fine offline out of box. 

For today I feel all quite fine by spending available small free time.
 To me, It will be fun in the far future to learn all about Driver Integration ...

I feel with this all critical updates finished.
 Still, It will be good to see things noticed by your sharp eyes before creating a zip package.

Hi vigipirate,

recovery system like for livesystem pro from kare.net.de

I create some short Configure Tutorials, and for LiveSystemPro I use "SystemRecovery" for short tutorial.
See Lancelot Reply 2: http://TheOven.org/index.php?topic=3052.msg36458#msg36458

Configure LiveSystemPro settings:
eg. How to enable "SystemRecovery" with LiveSystemPro ?

I believe Pictures are better compared to my bad English.

As written before and on the tutorial, you can use Azin side by side with Win10PESE using your personal plugins without conversion. 

Have fun