Make generate_data(batch_size=None) default to a batch size of 8

[markmc]

See

sdg/src/instructlab/sdg/generate_data.py

Lines 311 to 313 in ca30d98

	# FIXME: remove this when ilab knows to pass batch_size=0 with llama.cpp
	if batch_size is None:
	batch_size = 0

We currently default to zero, but this was a temporary measure until instructlab/instructlab#1797 lands

PipelineContext(batch_size=None) will default to 8

[github-actions]

This issue has been automatically marked as stale because it has not had activity within 90 days. It will be automatically closed if no further activity occurs within 30 days.

[bbrowning]

Still relevant, as we have some tech debt in both SDG and CLI repos managing this batch size today when we can unwind some of this.

[github-actions]

This issue has been automatically marked as stale because it has not had activity within 90 days. It will be automatically closed if no further activity occurs within 30 days.

[github-actions]

This issue has been automatically closed due to inactivity. Please feel free to reopen if you feel it is still relevant!